If ffmpeg/mencoder can convert mkv file to flv, vshare will be able to support it.

in include/settings/video_conversion.php

Add

$convert_mkv = "command for converting mkv video to flv here"

Mostly default convert command will work.

$convert_mkv = $cmd_all;

I am not sure if mencoder can convert this video extension.