New MoVirt release - introduction of augmented reality

  I decided to date this post for MoVirt release and since release has been delayed this post is delayed too.

  But now 0.2 beta version of MoVirt is available to everyone, and I'm very happy about this because the main feature introduced in this version is my work on augmented reality! You can check how does it work in this video:

  Also you can download latest test build for Android from here if you are using oVirt or interested in virtualization. This is unsigned package, so you need to copy .apk file into your android device, enable "Unknown sources" in Settings and install .apk file.

  To prepare this release I've spent three weeks fixing various bugs, stability and usability issues along with refactoring and cleaning some parts of the code. And there were two "interesting" tasks which annoyed me a lot.

  The first task was about android synchronization. We noticed that automatic synchronization with oVirt server happens only once a day and this may be not very good behavior for monitoring software, because you can easily skip some important events if you are relying on notifications from moVirt. According to android SDK documentation:

When a network connection is available, the Android system sends out a message every few seconds to keep the device's TCP/IP connection open. This message also goes to the ContentResolver of each app. By calling setSyncAutomatically(), you can run the sync adapter whenever the ContentResolver receives the message.

"every few seconds", but this is not working in moVirt for some reason. People at stackoverflow.com says that android documentation misguiding in some topics especially about synchronization, and I found the only working solution is to enable periodic sync with fixed custom interval which is not recommended. There is one more solution (which is possibly the best) is to use push-notifications via GCM, but this is far-far future plans which requires modification also in oVirt server.

  The second task was about proper storing time in database. Since we have information at what time connection to server was lost and when was the last successful synchronization, we need to store this information in database to share between activities and sessions (detailed about necessity of using database in previous post). My first thought was to use java.sql.Timestamp class because it specially designed to store time and date in database. As I understand this class contains Unix Time which is UTC time and converts to properly formatted string to store in database.

public String toString()

Formats a timestamp in JDBC timestamp escape format. yyyy-mm-dd hh:mm:ss.fffffffff, where ffffffffff indicates nanoseconds.

Everything was looking fine until I realized that time in database stored in local time zone! And if you change time zone in your device it will show wrong time. Who in the world needs to store date and time in database in local time zone? And why does this Timestamp class do this conversion implicitly in toString() function with no obvious way to avoid this conversion? Ok, there are LOTS of other classes to work with time in java, and I decided to find some ready to use code snippets to store time as string in database in UTC... I've spent three days trying different solutions and all of them was wrong and shows the wrong time, because every class in Java performs implicit time zone conversion even if it is not needed and not obvious for this action. So I stopped to store time in database just as Unix Time and convert to string only while displaying and this seems to work.

Becoming linux user

  Well, I delayed this post for few days, because I was busy with patches for moVirt and switching tasks in the middle is not good... But now I have time and there are important news I want to share.

  First thing that happened in last 2 weeks is that I finished with all base Augmented Reality features for moVirt. Now when you look at barcode you'll see information about host (status, CPU and memory usage), host events on right panel and host VMs on left panel. Also there is a button to open host details page where you could perform different actions with this host and VMs. The hardest thing is to optimize layout for variety of screen sizes and screen resolutions. On my 10" tablet all panels fits perfectly, but for smaller screens we need new design ideas.

Pic. 1. First look of AR screen with all base features.

  Second thing is that I'm Linux user now. For long time I've been avoiding this OS, but now it's time! To test moVirt features I need working setup of oVirt. Since oVirt is a linux software I need it running somewhere. For some time I've been using oVirt LiveCD booted from USB flash on my second laptop, until USB ports stopped working. I was looking for different solutions like running LiveCD .iso from HDD and from virtual machine and I realize that I need proper linux installation on my machine. I don't want to go deep with details, saying only that this way was also full of difficulties. To everyone how will try to install linux: don't try any optional solutions, follow only default, the most simple installation. You see that there is an option to install from .iso on hdd, and there is article in documetation? Don't try this, no one have tested this, you will be covered with bugs. You heard that there is no problem installing linux near windows installation? Don't trust them, erase your entire HDD (don't forget to backup...) and make a clean installation. Otherwise you will step into some bugs and lost dozens of hours.

Pic. 2. Meet the linux.

  After getting over through the troubles I was ready to install real oVirt engine, but with fake VDSM, because for testing purpose I don't need real hosts and VMs. In addition to the guide provided on the web-site we need few more steps:
1. Configure settings in database with this commands
psql engine -U postgres -c "UPDATE vdc_options set option_value = 'false' where option_name = 'SSLEnabled'"
psql engine -U postgres -c "UPDATE vdc_options set option_value = 'false' where option_name = 'EncryptHostCommunication'"
psql engine -U postgres -c "UPDATE vdc_options set option_value = 'false' where option_name = 'InstallVds'"

2. Uncheck "JSON Protocol" while creating host in web admin.

After that it was possible to create fake hosts and VMs to test moVirt.

First commit

  Two weeks passed and right at this point I've made pull request to moVirt repo with my commit. It's not actually "first" commit, there was several of them before the internship starts. And what I want to tell here is Git... I thought that I finally understand how to work with Git with help of my mentor during work on initial commit to apply to Outreachy. But on Friday I was confused and very frustrated again. The idea was to leave all day-by-day commits in my fork (so I could trace my progress later if I'll need to revert something), and send squashed version into main repo to ease reviewing. All my attempts was failed,.. seems like Git tries to reduce all redundancy. So then I decided to create patch which would contain all my commits in single file, then I erased everything in my repo because there was a lot of garbage of branches and merges, and just to avoid redundancy if Git decided just to link to previous commits instead of recreating them from patch, and last step was to apply patch... But who in the world could ever know that applying patch with multiple commits in it leads to reverted order of commits! I was one step before loosing everything I've done during this two weeks. Hopefully I've managed to recreate my progress from reversed commits on the weekend, and also I've made some fixes that I've forgotten before committing.

  So lets leave that freaky unhuman Git and get back to the commit. First thing I've realized learning ZXing that it doesn't assume to be used as a library inside another app. The integration class just makes calls to another app Barcode Scanner (BS) with it's own UI, thus preventing us from drawing any overlays on camera screen. Hopefully BS is a part of ZXing and also Apache licensed, so I've taken all decoder classes and build my own Activity class based on BS's Activity, so that we could decorate camera screen as we like. Also it could improve response time, because we don't need to support all barcodes, just choose one of them and skip guessing time.

  Looking through BS's Activity I've partially learned how parallel threads and handlers works in android. Activity has it's handler which loops through the message queue. Decoder works on another thread and posts messages when barcode has been detected and decoded. While catching such messages we could interact with Activity. All interactions occurs in function handleDecode(...), here we could ask data provider for Host instance which we are looking at, and show any desired information on screen. Also there is viewfinderView class that suits to draw anything on to the screen with Paint and Canvas classes. At this point I've made just simple rectangle that rounds decoded barcode in real-time to mark which one has been decoded if there are several of them on screen.

  Only two weeks (or less) required to bring Augmented Reality support with barcodes into your app. It may look not so fancy, but functional enough. And could be easily extended.

Pic.1. Test view with some fake data.

Internship starts!

  Yesterday was my first work day in Outreachy Program under moVirt project, so I'm starting this blog to share my progress and experience during my internship which will lasts the whole summer. I'm gonna post once every two weeks and will write about what have happened during those two weeks.

  As this is my first post and work only begins I'll mark here my plans with moVirt project. The main feature which I'm about to implement it is augmented reality for moVirt which will help maintain servers running oVirt. The point is to mark every server with sticker with some graphical code such as Data Matrix or QR-code (barcode), then focus camera of your smartphone or tablet and you'll see info about virtual machines running on this current host you are looking at.

  My first task was to find any appropriate lib for Android device which will handle barcode processing and suitable to implement inside moVirt app. My eye falls on ZXing Library, it perfectly fits requirements:

• it could be integrated into android app
• it's free and open-source under Apache licence
• it supports many types of barcodes so we can switch between them if necessary

  During upcoming days I'm gonna study documentation for this lib find some examples and tutorials. Also I will try to write some test code for moVirt.