The name Ninnaji, where the Ninnaji Shrine is located, comes from the fact that it was once part of the territory of Ninnaji Temple in Kyoto. The shrine is thought to have been founded in the early Muromachi period, and at that time was called Hakusan Gongensha. In 1633 (Kanei 9), Nagai Shinano no kami Naomasa became the feudal lord and began to enshrine Sugawara no Michizane, and since then it has also been called Tenmangu Shrine. It is said that the shrine building was washed away when the Yodo River embankment broke, so it was moved to its current location in the center of the village. Many trees are planted within the precincts.