Multiple USB serial ports?

Does anyone know how many serial ports you can run on a linux box using
USB to serial adapters? My brother is interested in using this aproach
to build a terminal server. He would like to run 16-32 ports to replace
his multiserial board that isn't quite as reliable as he would like.
Any ideas? Or anybody know of any really cheap terminal
servers/multiport boards?

Eric