Hi Preet,
Thanks for writing in! This is more of a WooCommerce related question so we may not be able to provide more complex advice should you need it. If you do then you may need to contact WooCommerce or engage a developer for a custom solution.
However, there is a basic setting that may do what you want.
1. Go to WooCommerce > Settings > Products > Inventory
2. Find Stock Display Format
3. Choose Only show stock when low
Thanks for understanding, and hope this helps!