You need to check the conversion command work on your server.

You can switch between ffmpeg and mencoder in include/settings/video_conversion.php

Refer

http://forums.buyscripts.in/viewtopic.php?t=352