I understand the root user under Linux and the goal of rooting an Android device. Though, when people say "rooting", does it mean I will always use my device as root? Or just while I apply my changes?
No. Rooting in that case means that apps are able to request root. If they do so, then usually a pop-up appears asking for your permission.