I would have to say that fishing is. The people who are fishing are not the ones who are doing all the work. They just throw in a really expensive rod with some high-tech bait, and wait to get lucky and catch some fish. I have no problem with fishing, even I fish myself. Fishing, however, is not a sport.
There's quite a few that i wouldn't consider a sport, Golf, fishing, and hunting i wouldn't consider a sport...like others have said it's more of a hobby. What's next, building model airplanes?
Is chess really recognized as a sport? If so than that definitely. Next ones for me would be fishing, golf, and darts. I agree with other posters when they say it's more of a hobby than anything.