David Allan has recalled seeing athletes visit the broadcaster's luxury apartment in Sydney.
The 79-year-old told Mr Jones's trial the radio host would hug and "slap on the bottom" of one high-profile complainant.
Mr Jones has pleaded not guilty to 21 charges of indecent assault and sexual touching against five male complainants.
David Allan, 79 is giving evidence in the broadcaster's indecent assault and sexual touching trial in the NSW Local Court.
Mr Jones has pleaded not guilty to 21 charges, including to allegations he kissed a prominent athlete, Complainant M, twice without his consent.
Mr Allan, who trained as a butler in the United Kingdom, said his former boss would have a "cavalcade" of famous people, including many high-profile sports stars, come through his Sydney apartment for lunches, dinners and parties.
Asked whether Mr Allan did in fact say the words "a slap on the bottom", the butler replied: "Probably the wrong thing to say today isn't it…"
"They slap each other, it's what they all do," he said, referring to the way sportsmen greet each other.
Mr Allan has been asked to recall specific guests Mr Jones had in his apartment as early as 2003.
The butler said he cannot recall many names, but accepted Mr Jones hosted "maybe half a dozen" young male athletes in their "early twenties".