The binaries are identical so it's extremely wasteful to rebuild the thing over and over again. The thin terminal builds account for a third of our current build time and could fairly easily be reduced to nothing.
The only problematic one is the Wyse build, which has a custom tlclient.bin in order to have the configuration UI. We could consider moving that to a separate binary so it could be built independently. Or perhaps always include it and hide the functionality.