Can dirt from containers go onto garden soil

Due to many trees and poor garden space, we grow tomatos in large pots. Can the used dirt from tomato plant be used in flower garden?

Doug says I put the used container gardening soil onto my garden without problems - have done so for years. It's mostly peat moss in any case so shouldn't hurt a thing. If you have lots of roots in the soil and it's in one big chunk, then you're going to want to chop it up and then turn it into the soil.