Yes, you can use it only to make and receive calls and text messages. Equivalent of not signing into a new device but inserting SIM.
I have seen people do this (without signing into Google account) , using it like a non-smartphone.
Somewhat related Can I use an Android One device without a Google account?