It dawned on me that ionice might show more perceptible results with *random* I/O, not just sequential writes from dev/zero. I bet some mix of ioniced random I/O (try R and W separately) whilst W from /dev/zero with no ioniceness will show some results... If not, someone needs to make a bugzilla!