11 years old is young to go to camp alone, I think. One thing for scouting is that the scout is NOT allowed into the tent of another adult. So if your son were there alone, he can't go into your neighbor and the neighbor son's tent if he is homesick. Better to just go yourself! I don't think four days of crying is okay either!
My 8 year old spent the night at a local camp through our city. I was a bit of a wreck but he had fun. We dropped him off at 7 pm and picked him up at noon, and that's only one day! He had fun.