Józef Rubiś’s first career was in cross country skiing. He won four Polish titles, one in the 30 km (1955) and three with his club Wisła Gwardia in the relay. Additionally, he came second at Polish championships eight times, and competed in the 1956 Olympics. Internationally, Rubiś fared better in the biathlon, which had been his main focus in the later part of his career. He placed a credible sixth at the 1964 Olympics, and at the 1965 World Championships, Rubiś came third in the 3 x 7.5 km relay, then an unofficial event. In 1966, when the event had gained official status as a four-person event, Rubiś helped Poland to a silver medal. Following his retirement in 1968, he worked as a biathlon coach for nearly three decades.