Emergency services and an ambulance were called to Centralbadet at 4.30pm on Sunday.
The boy, aged four, was then taken to hospital.
At seven o'clock the police announced that the boy had died.
- We do not know what has happened, but are investigating it now, says Camilla Larsson, officer on duty at the police.
Centralbadet is a bathhouse with an associated outdoor bath.