You might be able to find resources on the web that describe how to build up a sufficient windowing environment to support GUI applications such as the Update Tool.
As an alternative for headless systems, from within bin/ of your GlassFish installation, you can run the "pkg" CLI to perform package installation and updates of your GlassFish installation. Use pkg --help and/or the man page for details: