I have an Android device which does not have place to insert a SIM card, can I tether this device to PC through USB (I want it to be fast, hence preferring USB over Wifi) in some way?
If your device does not have tethering built in (Many devices do), you can get an app from the Play Store that allows you to tether your phone. There are several great applications that allow you to tether via USB or WiFi. A good app that solves this purpose is one called USB Tether https://play.google.com/store/apps/details?id=com.mkdev.usbtethering2 Its simple and functional.
There is an app whose minimum requirement is Android 4.0.3 . This app doesn't even require root access.
Install this application which will help you achieve USB tethering.
We used FoxFi and got it to work.