Rollbase does not support icons in tabs. This is something we have considered for related list and related list headers, and we will likely consider again in the future with the next version of our UI. I will track it as an enhancement request.
Thanks,
Matt