Pulse Audio for Multi-User System

Have you had a look at this: https://wiki.archlinux.org/index.php/PulseAudio
Particularly where it speaks about config files, and each user being able to have individual config?