What if I add new VMs in new subnets inside my on premises data center? Will the GCP VPC pick it up (assuming I have a VPN tunnel established)?
No. If you have just a VPN tunnel, the VPN Gateway does not allow dynamic routing.
How do you address this type of dynamic routing?
Cloud router is to be used for dynamic exchange of routes.