What are the best size, compression settings, and format for making video for playback on a Galaxy Tab 10.1?
The Galaxy Tab 10.1 will work best with MP4 files (H.264 encoding) at 720p (1280x720). Do not use Entropy Coding. I'm noticing a few problems with it; it could be the video / my setup though and not the device itself.
Use a constant bitrate at a reasonable quality level (RF:20 should be good, or around 1000kbps). Maximum B-Frames should be set to 0, and Reference frames to 4 or 5.
As far as audio goes you should be fine with most anything; a samplerate of 48 and a bitrate of 160 should be good. Make sure to downmix to stereo. AAC is probably you best bet for the codec.
Audio: AAC with Bitrate of 160, Samplerate of 48; downmix to stereo
Take a look at this thread on XDA-Developers forums. There's a good discussion with presets for Handbrake (conversion software) that should work well for GTab 10.1.
Basic settings are as follows: