tree 6d734064488bc9477a5474d8c127279392feee38
parent c37c680ae6e71f715bd7c540909155061bc44491
author Oleksandr "Alex" Zinenko <git@ozinenko.com> 1756727547 +0200
committer GitHub <noreply@github.com> 1756727547 +0000
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsFcBAABCAAQBQJotYj7CRC1aQ7uu5UhlAAAP4wQAIEjs7J8d1YOKTlJGK3etBon
 RRhhWqSEKMlDNXas3qrC0hlHh2E79xn1s4Psl22L2s0fHPtOJWNSo9auHM8LtFs1
 EPYmHAlBTuuXmqoEBuYiCDCGQOFBnsE/9NKwMIlgx+3zxyu/p3ZFcn8Q2AvvNV6g
 6CXfexGVFhzRqOXXv53Lme1l0Xilwr2I8Ppy/s1tb4nJamr7v5HZNtOzsN8vAgTF
 cFyWGvmEl+QFpgcPX0iHKnkQf/DuIkvZqlVVHn4rd+4TLkGwPhZS2QxwhLnbktng
 uSD2wg/TiS46g42cYKxcAPOpS4JUiaxrKe2X3fyS0nl0tbDSSjpwXPMaze61HSTH
 rldy2d5uJC5Tc9RYAzPP/TisVtGNjQC/4xX69JGnj5F9Mp7zw5F3d+acVjb24XO3
 pKI3W5d1+j+oOuxZwPNZKNT5s2QpCD1ClmyHksuNM9kBFnZyrwEZjQwQAjhGZgFh
 0jo44eP9y7UVQ5120ZOV8zMDma3PkO52RQx6FX+c3vdg652bKH/57ygCd6JWqoW1
 f8ovjLtqWsYisXzIR0St54L4gvJMHzMml0mGo/CL3aJJRRc1Q1y7oDz45epEnJp+
 ZMn4Mrg5yjyx/Tr+OG/LJQNu8mQcjKzqZCMFAMNugzuRYCO7l4Fu1CsnZyL+lOQ3
 7OWLhF+U/BJfi7/cssbu
 =fa94
 -----END PGP SIGNATURE-----
 

[codegen] more consumer fusion (#21521)

Enable consumer fusion to fuse more trailing operations, in particular
to fuse all operations used in layer normalization. The particular
enablement is to allow fusion of consumers of fused operations that are
not the "main" operation into which fusion happens.

This required three modifications:

1. Generate replacement values for any fused operation whose results are
used by operations dominated by the main operation (that will turn into
a loop). This is needed because the consumer fusion finds candidates
based on `insert_slice` operations in the loop that are not produced
unless the replacement values are generated. In the case of layer
normalizaiton, we also need actual replacement values so we can return
them. Spurious values are being cleaned up by canonicalization patterns
in the same pass.
2. Avoid generating replacement values for values used as DPS inits as
those cannot (currently) be fused.
3. Sort consumers to fuse by dominance and first most-dominating
consumer fuse to avoid triangular-use situation that prevents fusion.

This generally makes fusion more aggressive on the consumer side.

Signed-off-by: Alex Zinenko <git@ozinenko.com>