The first religious buildings in Rudy were built the owners of these lands, Counts of Ballestrems, in the nineteenth century. Those were two chapels of Our Lady of the Rosary and of Saint Joseph. At the beginning of the twentieth century, Francis Xavier von Ballestrem founded a new, grandeur shrine. It was the brick church of Saint Joseph, which was completed in 1904. The church was erected in the stately neo-Romanesque style. After two years, it became the seat of an independent parish.