How strict is too strict?

So I attempted to have an interesting conversation with a co-worker today after overhearing part of his convo with another co-worker about God and Jesus and stuff. Anyways, this part of the convo was directed towards Church Music, more specifically, using instruments during our music times at church. Now, he was saying that there is no biblical basis for using musical instruments; therefore, he believes (and I think his church as well) that when worshiping through music that we should not use instruments because the Bible does not say to do so. Sadly, we could not elevate the conversation today because of time constraints, guests, work stuff, and him not directly answering questions I was asking him. The way he said it made it sound like he believed it was wrong to do these things, even though he would not strictly say that. But he brings up an interesting point, even though I don't agree with him fully on what he is saying. Should our churches/us do things that are not specifically laid out in the Bible during our services/lives? Is it wrong to use musical instruments/do whatever it is just because the Bible doesn't explicitly tell us to do so?

Now I have a completely different opinion and an entirely different response to these comments that I couldn't express today because of time and I'll share later after yall discuss some. So, Ready, Set, Discuss!