Should the filter be fully submerged?

Just got 2 turtles, got tank, heater, filter etc but even tho put the filter in the water still looks bit grubby even tho just got them yesterday. I can hear the filter vibrating but not sure if it should be fully under the water or not?