sitecore - allow access to sitemap.xml while disallowing other xml files

sitecore - allow access to sitemap.xml while disallowing other xml files

In our sitecore 6.6.0 (rev. 130404) project we have a sitemap.xml file in
the root folder. However that file cannot be accessed from the browser
because of a configuration in web.config.
<add path="*.xml" verb="*" type="System.Web.HttpForbiddenHandler"
name="xml (integrated)" preCondition="integratedMode"/>
This configuration was added as instructed in the sitecore security
hardening guide.
If we remove this configuration, a user is able to access any .xml file
inside the sitecore folder. How can we only allow access to sitemap.xml
while disallowing access to other xml files in the website?
(We are running on IIS7 Integrated Mode)