Sitemaps are hard to debug
 

So if you did it right, you have nothing to worry about. Plus you can always check your errors in Google Search Console under international targeting. That being said, if you have a really large site, then you should use a sitemap and check for errors manually.