While some people may not be too bothered about what people get up to in their own homes, others will find the smell in particular annoying.
The smell of cannabis is quite hard to miss or mistake and it's even harder to get rid of.
But what can you do, if anything, if you think your neighbours are smoking or even growing the drug near your home?
Contact the police
Although some people think that it's perfectly legal if you're only smoking cannabis in your own home, they are sadly mistaken.
Cannabis is still a Class B drug and anyone caught in possession is committing an offence and will be dealt with by police.
Police said the force and its partners 'will continue to take action to improve the quality of life for communities who are affected'.
However, they have stressed that their best method of tackling the problem is with help from the public.
'˜Local residents are often best placed to see on a daily basis whether their neighbours are behaving suspiciously and could be in possession of, cultivating or supplying drugs in their homes,'Â added aÂ police spokesperson.
But, police have also stressed that your neighbours won't find out that you're the one who's tipped them off.Â
Officers will say they received a call about cannabis usage and may also use the tip-off as a starting point on areas they will patrol.
If the officers then smell the cannabis themselves, they may knock on the door and tackle the problem themselves.
Crimestoppers has also said that members of the public can contact them anonymously if they think their neighbours are smoking or cultivating cannabis near them.
'˜If you spot any of the signs that there may be a cannabis farm in your community you can call Crimestoppers anonymously on 0800 555 111 or use our Anonymous Online Form,' advised a spokesperson.
'˜You will not be asked any personal details and neither your telephone number nor IP address will not be traced or recorded.'Â
Speak to the landlord
If your neighbours rent their property, you can contact their landlord about the issue, but there are constraints as to what the property owner can do.
'˜If you own or let a property you need to be aware of your responsibility to ensure cannabis is not grown on your premises,'Â said a policeÂ spokesperson.
'˜Consequences of allowing cannabis cultivation include reduction in property values, increased insurance premiums, hostile tenants, and up to 14 years imprisonment and a criminal record.'Â
If a landlord suspects the use of cannabis on their property, they can arrange a visit as long as they have warned their tenant they will be doing so.
However, landlords are not bound to keep your tip-off anonymous like the police are.
This article originally appeared on our sister site, Peterborough Telegraph Â