2.1 Database Love

Long time no post.  But I think this is a nice time to send one out.  Been working a lot on changing how the database gets stored on disk. The first big project is less reliance on the pickle module.  I’ll let the terminal session speak for itself.


ben@pitpat:~/miro-dev-home/.miro$ sqlite3 sqlitedb
SQLite version 3.5.9
sqlite> .tables
channel_folder              playlist
channel_guide               playlist_folder
directory_feed_impl         remote_downloader
directory_watch_feed_impl   rss_feed_impl
feed                        rss_multi_feed_impl
field_impl                  scraper_feed_impl
file_item                   search_downloads_feed_impl
http_auth_password          search_feed_impl
icon_cache                  single_feed_impl
item                        taborder_order
manual_feed_impl            theme_history
miro_version                widgets_frontend_state

sqlite> SELECT origURL, title, feed.id FROM feed, rss_feed_impl fi WHERE fi.ufeed_id = feed.id;
http://feeds.miroguide.com/miroguide/new  New in Miro Previews  12
http://feeds.miroguide.com/miroguide/fea  Featured Channel Pre  13
http://www.linktv.org/rss/hq/globalpulse  Global Pulse          15
http://ewheel.democracynow.org/rss.xml    Democracy Now! Video  193
http://feeds.pbs.org/pbs/wgbh/nova-video  NOVA Vodcast | PBS    277

sqlite> SELECT f.title, i.entry_title FROM rss_feed_impl as f, item as i WHERE
...> i.feed_id = f.ufeed_id AND f.ufeed_id=193;
Democracy Now! Video Torrents  Democracy Now! Wednesday, March 25, 2009
Democracy Now! Video Torrents  Democracy Now! Tuesday, March 24, 2009
Democracy Now! Video Torrents  Democracy Now! Monday, March 23, 2009
Democracy Now! Video Torrents  Democracy Now! Friday, March 20, 2009
Democracy Now! Video Torrents  Democracy Now! Thursday, March 19, 2009
Democracy Now! Video Torrents  Democracy Now! Thursday, August 21, 2008
Democracy Now! Video Torrents  Democracy Now! Wednesday, August 20, 200

8 comments ↓

#1 Will’s Miro dev blog » Blog Archive » db changes garner no response on 04.07.09 at 7:38 pm

[...] surprised that Ben’s post didn’t garner any response. I thought there was a significant number of people chomping at [...]

#2 Sir_Sid on 04.07.09 at 9:57 pm

<3

#3 stantontas on 04.08.09 at 12:11 pm

Heh. No wonder you got no response. Does this also come in English?

#4 bdk on 04.08.09 at 12:14 pm

stantontas: nope :)

The quick version is that the format of our database files are going to be much more readable/modifyable by hackers and 3rd party tools.

#5 working on speed for miro 2.1 « Miro - Internet TV Blog on 05.04.09 at 2:52 pm

[...] core Miro users with thousands of items could see speedups of 4 times or more. Here’s some techy details from bdk, who has been spearheading the changes. « Meet Orim: The Miro [...]

#6 Jonas on 05.08.09 at 1:21 am

yay, i have waited so long for this

#7 Getting 2.5 ready for launch « Miro - Internet TV Blog on 06.04.09 at 11:17 am

[...] this release has some serious speed and memory improvements.  Much of this was accomplished by changes to the database.  To make testing less risky, we have implemented automatic database backups prior to upgrade. [...]

#8 db changes garner no response | rapid-DEV.net on 06.15.09 at 1:28 am

[...] surprised that Ben’s post didn’t garner any response. I thought there was a significant number of people chomping at [...]

Leave a Comment