Pretty much.
Or, to say it another way, it's easier to keep up viewship during moves when you appeal to a wider demo of audience, and can absorb drops from people DVR or streaming because of the change.  If your show targets a narrow demographic, then gets moved against something that competes against the same demo, your going to take a bigger hit than a show with a larger demographic moving.  
I fell into that category.  Last season, I always looked forward to watching SGU on Friday.  But this season, I'd always forget SGU was on because I was watching NCIS.  About 20 minutes in, this thread would pop up and I'd curse myself for missing the episode again.
  It also helps when you're not moved against the #1 and #2 scripted shows on television.