Yeah, I agree with you on both points, and like your line-up. It does bugs me that Spider-Man is in both titles, he should just be in Avengers and have DD replace him in NA.
Yeah, Daredevil should be on the New Avengers at the very least. But I'd really just like to see him as an Avenger for a short while, he's like the only major Stan Lee character that hasn't been on the team beyond just a few appearances.
To me the perfect Avengers line-up would have all the A-listers. While I often disagree with Mark Millar, I absolutely agree with him on why I like team books. With Justice League you get all the A-listers (Batman, Superman, Wonder Woman, Green Lantern, the Flash), and it's badass seeing these guys team up and take names. So to me, the Avengers should have Captain America, Iron Man, Thor, Hulk, and Spider-Man. Outside of the X-Men and Fantastic Four, these guys are Marvel's A-list.
But what makes the Avengers, better than the Justice League is that the Justice League roster feels too static. Outside of a certain set of B-listers (Aquaman, Green Arrow, Black Canary, Martian Manhunter, the Atom, Hawkman, Red Tornado, Elongated Man, Zatanna), it doesn't feel right to have other heroes step up to the plate and be a part of the Justice League. But with the Avengers, it feels much more comfortable to include more B-listers, C-listers, all the way up to Z-listers. But if I had to pick a certain set of B/C-listers I would go with Hank Pym, Janet van Dyne, Ms. Marvel, Wonder Man, Hawkeye, Quicksilver, and the Scarlet Witch and have all of the characterization focus on the characters who don't have a book. But honestly, unlike with the Justice League, I (and I'm sure others) would be totally open to other characters like Songbird, the Thing, Hercules, the Falcon, Justice, etc.