Places of worship often have dress codes, whether they are explicitly stated or not. People may feel that you are being disrespectful and inappropriate if you ignore the rules and do things your own way.