The idea that there shouldn't be musical instruments in church is held by some Protestants that believe in the regulative principle. This was popular in Scotland in the 1800's, where the Campbell's were from, early leaders of the Restoration Movement, the historical root of a movement in the US which calls their churches 'Church of Christ' or 'Christian Church'.
Early Protestants modified Roman Catholic liturgy, trying to find Biblical justification for the components they kept or expanded, and doing away with parts for this they could not find Biblical support. Those who hold to the regulative principle believe they need to do only things the Bible instructs in church meetings.
The irony, here, is that there is actually a passage of scripture that says what to do in church that isn't paid much attention to. I Corinthians 14:26 shows us that 'every one of you' may sing a psalm, have a doctrine, tongue, revelation, interpretation, provided 'all things be done unto edifying.' There are specific instructions for speaking in tongues with interpretation, and specific instructions for prophets and others prophesying in church. Paul calls his instructions 'commandments of the Lord.'
The passage doesn't say have three hymns, prayer, offering, sermon by one preacher, hymns, and prayer. The indication is that there are multiple speakers in one church meeting.
As far as musical instruments go, this particular passage doesn't address it. It seems more to allow for solos than congregational singing. Though that doesn't mean congregational singing is forbidden. It was the practice to sing Psalms after the Lord's Supper 'congregationally', I've read, and the Lord did that with the disciples.
The Old Testament also teaches us that praising God to the sound of musical instruments is good. Revelation shows people with harps and the sound of harps in heaven. So it's not something evil.
It is weird that people will get so legalistic over something like musical instruments in church based on the fact that the instructions about them are in the Old Testament rather than New Testament scripture, if their church doesn't follow the commandments the Lord gave in the New Testament for church meetings. Some of the folks I've encountered who are against musical instruments are dead set allowing having tongues and interpretation or prophecies in church meetings like the Lord commands in I Corinthians 14.