(These instructions pertain to Toolset Extensions, not Engine Extensions.)
1) Download the extension (it's always provided as a .jar file)
2) Copy that file into [WORKSPACE]/extensions/
3) Restart Stencyl, and the extension should be recognized. (Check the Extensions menu to verify its existence)
If you are unable to install an extension, contact the extension's author for help.