What tricks do engineers and scientists use to improve processor performance?

Improve the internal architecture of processors: increase the number of computing cores, increase performance per clock, reduce latency in data exchange between processor cores, increase the processor memory controller bandwidth, cache memory size and speed, increase the clock frequency, introduce new instruction sets in support. accelerating typical operations and work with certain types of data (for example, video encoding).