Many people find it very hard to lose love handles.
It's definitely one of the more stubborn areas, but it isn't anywhere near impossible to lose the fat around the stomach area.
Being physically active regularly will speed up the results; but what you put into your mouth plays a large role as well and shouldn't ever be ignored, no matter who you are.

• Avoid Sugar.
  Sugar is like a death trap if you are trying to lose belly fat.
  Eating a small amount of sugar from foods containing natural sugars, like fruits, is perfectly okay.
  It's best to avoid foods like snack cakes and pastries.
  Soda pop should also be avoided.
  
• Consume Protein.
  Protein helps your body to build lean muscle mass.
  The more lean muscle you have, the more fat your body will burn.
  Lean meats like grilled chicken and turkey are great sources of protein.
  Vegetarians can still get plenty of protein with supplements.
  
• Eat Good Fats.
  It's important that not all fatty foods are avoided.
  In order to burn fat, it actually helps if the body is getting some good fats.
  Good fats, such as omega-3's, are found in many types of fish like salmon and mackerel as well as fish oil supplements.
  
• Eat Whole Grains.
  Avoid white pastas and breads because they are made with refined flours and do not provide any good nutritional value.
  Eating whole grain breads and pastas provides the body with the fiber and whole grains that it needs to be healthy.
  

When you eat a healthy diet, you will be able to eat a lot more food because it isn't so calorie dense.
As long as you watch what you eat and concentrate on eating fewer calories, you will start to lose weight from all over the body and that will help you to lose love handles.