Upgrading your Generators usually happens more slowly than upgrading your items, even though the process is exactly the same: find items that are part of the Generator’s Item Path and merge them.

You can get Generator items from reward chests.

Upgrading Generators is always a good idea! The higher-level a Generator becomes, the more powerful it will be, and thus it will have a higher chance of creating more higher-level items for you.