You haven't described the lunch you eat. If you eat a large lunch, you will not have emptied your stomach completely. Try eating a small lunch, then after your workout, eat a normal supper meal. If you get hungry in the afternoon, you may need to have a small snack.
I always found that the best workout was in the morning, before eating anything, about an hour after an early cup of coffee.