A “server” is an altar boy who assists the priest celebrating the Catholic Mass. Since even the celebrant performs his actions in the service of God, servers may be seen as "A server of a servant." Stephen stood beside Buck Mulligan as he adopted the role of celebrant at the beginning of this episode, and now he contemplates bringing Mulligan's shaving bowl or chalice down into the tower, so he may well conceive of himself in these terms.