In my brief testing, formatting a drive as vfat and mounting it, then changing the ownership to your user of the mountpoint, unmounting and remounting results in a drive the user can write to. Maybe it is a limitation of exfat?
I came across this:
Try adding uid=M,gid=N to the options where M is your user ID and N your group id (you can find these by running the command id in a terminal).