According to this answer, the “Compile source packages” checkbox does nothing
Thanks, created an issue here.