You're measuring the board, not the chip. Those devkits have a USB-serial bridge, a linear regulator with a fat quiescent current, and a power LED. All of it stays on.