I don't think trun the switch to another mode would break the board or somthing, just turn it back... in case it is really broken, follow below link to restore.
https://docs.blackfin.uclinux.org/doku.php?id=bootloaders:u-boot:loading
regarding the bootmode switch, you can get detailed information either from the HRM or the board schematics.