The Belgian was the IOC's eighth chairman and led the Olympic movement between 2001 and 2013. He himself participated in three Olympics as a sailor in the Finn dinghy class in 1968, 1972 and 1976.
"He was a perfect chairman who helped modernize and transform the IOC.
He will be especially remembered for his support of youth sports and for the creation of the Youth Olympics ", says IOC chairman Thomas Bach in a statement.
The IOC will have the flag at half mast at headquarters in Lausanne for five days.
Jacques Rogge turned 79 years old.
He leaves behind his wife Anne, a daughter and two grandchildren.