Competing for Denmark, Ove Nielsen was in his rowing prime in the aftermath of World War II. He won bronze in the coxed fours at the 1949 European Championships, alongside Niels Kristensen, Peter Hansen, Bent Blach Petersen, and non-Olympian Sven E. Larsen. The same squad, with Eivin Kristensen replacing Larsen, went on to win gold at the 1950 European Championships and also competed at the 1952 Helsinki Olympics, where they were eliminated in the semi-finals repêchage. Following his retirement, Nielsen moved to Norway, where he operated a hotel in Lillehammer. In his 80s, he sold this business and bought a ferry that he converted into a restaurant, selling that venture two years later.