I've never found my phone's compass to be terribly reliable, some apps have a Qibla map which I find very helpful to work out the correct direction.