Question

Can I leave them In the pot I bought them in?

Answer

You do not want to leave your hydrangea in the blue pot all season. Either plant it in the ground or in a decorative container (https://youtu.be/pvKcieDfDcE) so that the roots can grow in to establish and take up water and nutrients from the soil.