We've just moved our tempdb's from memory to file systems freeing up lot of memory for cache.
Then we just added a cache in front of it to cover 20% of the size which covers 80% of time of tempdb usage. We do find the caches in front of tempdb's do help performance (especially for the syslogs) but you might only need them to be fairly small.