Arseny Kapoulkine 80928acb92 CodeGen: Extract all vector tag patching into TAG_VECTOR (#1171) ... Instead of patching the tag component with TVECTOR in every instruction that produces a vector value, we now use a separate IR instruction to do this. This reduces implementation redundancy, but more importantly allows for a class of optimizations: - NUM_TO_VECTOR previously patched the component unconditionally but the result was used only in MUL/DIV_VEC instructions that ignore it anyway; we can now remove this. - ADD_VEC et al can now forward the source of TAG_VECTOR instruction of either input; this shortens the latency chain and in the future could allow us to generate optimal vector instruction sequence once the temporary stores are marked as dead. - In the future on X64, ADD_VEC et al will be able to analyze the input instruction and remove tag masking conditionally. This is not part of this PR as it requires a decision around expected FP environment and/or the necessity of the existing masking to begin with. I've also renamed NUM_TO_VECTOR to NUM_TO_VEC so that "VEC" always refers to "3 float values" and for consistency with ADD/etc. Note: ADD_VEC input forwarding is currently performed unconditionally; it may or may not increase the spills that can't be reloaded from the stack. On A64 this makes the Taylor series computation a tiny bit faster (11.3ns => 11.0ns) as it removes the redundant ins instructions along the NUM_TO_VEC path. Curiously, the optimization of forwarding TAG_VECTOR input to arithmetic instructions actually has a small penalty as without it this PR runs at 10.9 ns. I don't know if this is a property of the benchmark though, as I just noticed that in this benchmark type inference actually fails to infer parts of the computation as a vector op. If desired I will happily omit this part of the change and we can explore that separately.		2024-02-21 07:06:11 -08:00
..
conformance	Sync to upstream/release/611 (#1160)	2024-02-02 13:32:42 -08:00
require	Sync to upstream/release/607 (#1131)	2023-12-15 13:29:06 -08:00
AssemblyBuilderA64.test.cpp	Improve A64 lowering for vector operations by using vector instructions (#1164)	2024-02-16 08:30:35 -08:00
AssemblyBuilderX64.test.cpp	Sync to upstream/release/610 (#1154)	2024-01-26 19:20:56 -08:00
AstJsonEncoder.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
AstQuery.test.cpp	Sync to upstream/release/607 (#1131)	2023-12-15 13:29:06 -08:00
AstQueryDsl.cpp	Sync to upstream/release/549 (#707)	2022-10-14 12:48:41 -07:00
AstQueryDsl.h	Sync to upstream/release/549 (#707)	2022-10-14 12:48:41 -07:00
AstVisitor.test.cpp	Sync to upstream/release/501 (#20)	2021-11-01 14:52:34 -07:00
Autocomplete.test.cpp	Sync to upstream/release/612 (#1162)	2024-02-09 09:51:12 -08:00
BuiltinDefinitions.test.cpp	Sync to upstream/release/567 (#860)	2023-03-10 12:21:07 -08:00
ClassFixture.cpp	Sync to upstream/release/600 (#1076)	2023-10-20 18:10:30 -07:00
ClassFixture.h	Sync to upstream/release/600 (#1076)	2023-10-20 18:10:30 -07:00
CodeAllocator.test.cpp	Sync to upstream/release/597 (#1054)	2023-09-29 18:13:05 -07:00
Compiler.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
Config.test.cpp	Sync to upstream/release/501 (#20)	2021-11-01 14:52:34 -07:00
Conformance.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
ConstraintGeneratorFixture.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
ConstraintGeneratorFixture.h	Sync to upstream/release/602 (#1089)	2023-11-03 16:45:04 -07:00
ConstraintSolver.test.cpp	Sync to upstream/release/602 (#1089)	2023-11-03 16:45:04 -07:00
CostModel.test.cpp	Sync to upstream/release/591 (#1012)	2023-08-18 11:15:41 -07:00
DataFlowGraph.test.cpp	Sync to upstream/release/607 (#1131)	2023-12-15 13:29:06 -08:00
DenseHash.test.cpp	Sync to upstream/release/561 (#820)	2023-01-27 14:28:31 -08:00
DiffAsserts.cpp	Sync to upstream/release/600 (#1076)	2023-10-20 18:10:30 -07:00
DiffAsserts.h	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
Differ.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
Error.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
Fixture.cpp	Sync to upstream/release/609 (#1150)	2024-01-19 10:04:46 -08:00
Fixture.h	Sync to upstream/release/609 (#1150)	2024-01-19 10:04:46 -08:00
Frontend.test.cpp	Sync to upstream/release/608 (#1145)	2024-01-12 14:25:27 -08:00
InsertionOrderedMap.test.cpp	Sync to upstream/release/580 (#951)	2023-06-09 10:08:00 -07:00
IostreamOptional.h	Sync to upstream/release/603 (#1097)	2023-11-10 13:10:07 -08:00
IrBuilder.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
IrCallWrapperX64.test.cpp	Sync to upstream/release/601 (#1084)	2023-10-27 14:18:41 -07:00
IrLowering.test.cpp	CodeGen: Extract all vector tag patching into TAG_VECTOR (#1171)	2024-02-21 07:06:11 -08:00
IrRegAllocX64.test.cpp	Sync to upstream/release/595 (#1044)	2023-09-15 10:26:59 -07:00
JsonEmitter.test.cpp	Sync to upstream/release/543 (#657)	2022-09-01 16:14:03 -07:00
Lexer.test.cpp	Sync to upstream/release/570 (#885)	2023-03-31 11:42:49 -07:00
Linter.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
LValue.test.cpp	Sync to upstream/release/557 (#794)	2023-01-04 12:53:17 -08:00
main.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
Module.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
NonstrictMode.test.cpp	Sync to upstream/release/574 (#910)	2023-04-28 12:55:13 -07:00
NonStrictTypeChecker.test.cpp	Sync to upstream/release/611 (#1160)	2024-02-02 13:32:42 -08:00
Normalize.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
NotNull.test.cpp	Sync to upstream/release/555 (#768)	2022-12-02 10:09:59 -08:00
Parser.test.cpp	Sync to upstream/release/609 (#1150)	2024-01-19 10:04:46 -08:00
RegisterCallbacks.cpp	Sync to upstream/release/594 (#1036)	2023-09-07 17:13:49 -07:00
RegisterCallbacks.h	Sync to upstream/release/594 (#1036)	2023-09-07 17:13:49 -07:00
Repl.test.cpp	Sync to upstream/release/553 (#742)	2022-11-10 14:53:13 -08:00
RequireByString.test.cpp	Sync to upstream/release/607 (#1131)	2023-12-15 13:29:06 -08:00
RequireTracer.test.cpp	Sync to upstream/release/514 (#372)	2022-02-17 17:18:01 -08:00
RuntimeLimits.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
ScopedFlags.h	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
Set.test.cpp	Sync to upstream/release/604 (#1106)	2023-11-17 10:46:18 -08:00
Simplify.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
StringUtils.test.cpp	Sync to upstream/release/588 (#992)	2023-07-28 08:13:53 -07:00
Subtyping.test.cpp	Sync to upstream/release/611 (#1160)	2024-02-02 13:32:42 -08:00
Symbol.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
ToDot.test.cpp	Sync to upstream/release/611 (#1160)	2024-02-02 13:32:42 -08:00
TopoSort.test.cpp	Sync to upstream/release/523 (#459)	2022-04-14 16:57:43 -07:00
ToString.test.cpp	Sync to upstream/release/611 (#1160)	2024-02-02 13:32:42 -08:00
Transpiler.test.cpp	Sync to upstream/release/608 (#1145)	2024-01-12 14:25:27 -08:00
TxnLog.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
TypeFamily.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.aliases.test.cpp	Sync to upstream/release/612 (#1162)	2024-02-09 09:51:12 -08:00
TypeInfer.annotations.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.anyerror.test.cpp	Sync to upstream/release/604 (#1106)	2023-11-17 10:46:18 -08:00
TypeInfer.builtins.test.cpp	Sync to upstream/release/608 (#1145)	2024-01-12 14:25:27 -08:00
TypeInfer.cfa.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
TypeInfer.classes.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
TypeInfer.definitions.test.cpp	Sync to upstream/release/608 (#1145)	2024-01-12 14:25:27 -08:00
TypeInfer.functions.test.cpp	Sync to upstream/release/612 (#1162)	2024-02-09 09:51:12 -08:00
TypeInfer.generics.test.cpp	Sync to upstream/release/612 (#1162)	2024-02-09 09:51:12 -08:00
TypeInfer.intersectionTypes.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.loops.test.cpp	Sync to upstream/release/610 (#1154)	2024-01-26 19:20:56 -08:00
TypeInfer.modules.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
TypeInfer.negations.test.cpp	Sync to upstream/release/574 (#910)	2023-04-28 12:55:13 -07:00
TypeInfer.oop.test.cpp	Sync to upstream/release/610 (#1154)	2024-01-26 19:20:56 -08:00
TypeInfer.operators.test.cpp	Sync to upstream/release/603 (#1097)	2023-11-10 13:10:07 -08:00
TypeInfer.primitives.test.cpp	Sync to upstream/release/600 (#1076)	2023-10-20 18:10:30 -07:00
TypeInfer.provisional.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.refinements.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.rwprops.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
TypeInfer.singletons.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.tables.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.tryUnify.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
TypeInfer.typePacks.test.cpp	Sync to upstream/release/608 (#1145)	2024-01-12 14:25:27 -08:00
TypeInfer.typestates.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.unionTypes.test.cpp	Sync to upstream/release/613 (#1167)	2024-02-15 18:04:39 -08:00
TypeInfer.unknownnever.test.cpp	Sync to upstream/release/607 (#1131)	2023-12-15 13:29:06 -08:00
TypePack.test.cpp	Sync to upstream/release/571 (#895)	2023-04-07 14:01:29 -07:00
TypePath.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
TypeVar.test.cpp	Sync to upstream/release/597 (#1054)	2023-09-29 18:13:05 -07:00
Unifier2.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00
Variant.test.cpp	Sync to upstream/release/552 (#735)	2022-11-04 10:33:22 -07:00
VecDeque.test.cpp	Sync to upstream/release/612 (#1162)	2024-02-09 09:51:12 -08:00
VisitType.test.cpp	Sync to upstream/release/605 (#1118)	2023-12-01 23:46:57 -08:00