Commit Graph

174373 Commits

Author SHA1 Message Date
oyzh
f528aaff49 Adjust the build config to an existing value defined in .bazelrc 2025-01-10 20:47:59 -08:00
Zixuan Jiang
3c90759985 Rewrite Reshard(HloSharding::Replicate()) as Replicate() for PartitionedHlo.
PiperOrigin-RevId: 713681703
2025-01-09 08:58:36 -08:00
Eugene Zhulenev
752229b38b [xla:cpu] Consolidate all XLA:CPU collectives under backends/cpu/collectives
PiperOrigin-RevId: 713680966
2025-01-09 08:47:20 -08:00
A. Unique TensorFlower
7fab320b49 Extend MTK dispatch API to support DMA-BUF buffers
PiperOrigin-RevId: 713677908
2025-01-09 08:36:31 -08:00
David Dunleavy
765be4d43e Update users of moved TSL headers to use new location in XLA
This gets rid of any problems arising from TF's direct use of headers (see changes in `tensorflow/{c,core}`) such that all other users can be handled with automated changes.

PiperOrigin-RevId: 713676354
2025-01-09 08:26:48 -08:00
Penporn Koanantakool
d7a41d2c45 [xla:cpu:benchmarks] Add scripts to run Gemma2 Keras model.
PiperOrigin-RevId: 713674776
2025-01-09 08:14:04 -08:00
Eugene Zhulenev
7b49ba401a [xla:cpu] Replace xla::cpu::CollectivesInterface with xla::cpu::CpuCollectives
PiperOrigin-RevId: 713661518
2025-01-09 07:21:15 -08:00
Bart Chrzaszcz
cf43bb53b5 #sdy support JAX callbacks through the Shardy XLA round-trip pipeline.
PiperOrigin-RevId: 713646485
2025-01-09 06:23:09 -08:00
Mohammed Anany
8f94e73026 Moving test from Triton patch file internally. The associated fix was obsolete when reorderValues function was removed. We still want to keep the test and remove the patch.
PiperOrigin-RevId: 713638728
2025-01-09 05:45:44 -08:00
A. Unique TensorFlower
54e4a84e39 Automated Code Change
PiperOrigin-RevId: 713633408
2025-01-09 05:37:06 -08:00
A. Unique TensorFlower
5844fae1dd Automated Code Change
PiperOrigin-RevId: 713630341
2025-01-09 05:22:50 -08:00
A. Unique TensorFlower
167dfc4d90 Automated Code Change
PiperOrigin-RevId: 713628733
2025-01-09 05:10:27 -08:00
A. Unique TensorFlower
e8e48a3335 Automated Code Change
PiperOrigin-RevId: 713628270
2025-01-09 04:57:34 -08:00
Greg Olechwierowicz
2332929db5 [XLA:GPU] Use output_bytes_accessed in SoL latency estimator.
PiperOrigin-RevId: 713624097
2025-01-09 04:41:06 -08:00
A. Unique TensorFlower
b12d4ba33d Automated Code Change
PiperOrigin-RevId: 713622968
2025-01-09 04:30:32 -08:00
Greg Olechwierowicz
ed61e14a43 [XLA:GPU] Model output_bytes_accessed for collectives.
PiperOrigin-RevId: 713610688
2025-01-09 03:44:58 -08:00
Chris Jones
1f58545523 [xla:gpu] Only run XLA Triton passes on XLA fusions.
PiperOrigin-RevId: 713609640
2025-01-09 03:33:16 -08:00
A. Unique TensorFlower
a4d4a095c8 Automated Code Change
PiperOrigin-RevId: 713601879
2025-01-09 03:00:07 -08:00
A. Unique TensorFlower
2f389ffb35 Automated Code Change
PiperOrigin-RevId: 713597458
2025-01-09 02:48:52 -08:00
A. Unique TensorFlower
1d54c406e1 Automated Code Change
PiperOrigin-RevId: 713597347
2025-01-09 02:38:33 -08:00
Ilia Sergachev
49d396c843 PR #21175: [DOC] Fix a mistype.
Imported from GitHub PR https://github.com/openxla/xla/pull/21175

Copybara import of the project:

--
caaf17448ae8dade929d728852093ec82384337b by Ilia Sergachev <isergachev@nvidia.com>:

[DOC] Fix a mistype.

Merging this change closes #21175

PiperOrigin-RevId: 713594132
2025-01-09 02:25:49 -08:00
Ilia Sergachev
4d3e63f000 PR #21166: [DOC] Fix a link in the documentation.
Imported from GitHub PR https://github.com/openxla/xla/pull/21166

Copybara import of the project:

--
b939d5aea471e4b267a806b19102b6d56a7abe0a by Ilia Sergachev <isergachev@nvidia.com>:

[DOC] Fix a link in the documentation.

Merging this change closes #21166

PiperOrigin-RevId: 713589150
2025-01-09 02:14:57 -08:00
Zixuan Jiang
1240e44fe9 Generalize GetFirstMergeableDimForSortOperand and rename it as GetFirstTargetDimToMoveShardingTiles.
`GetFirstTargetDimToMoveShardingTiles` can be used for moving the sharding tiles from a source dimension to a target dimension when the source dimension and target dimension are different and the size of target dimension is divisible by the merged tile size. This util function will be used in the dimensions that need replication in the partitioner.

This cl has no behavior change. We will use this util function to support
1. Concat dimension in concat operations
2. Slice dimensions in dynamic-slice operations

PiperOrigin-RevId: 713588209
2025-01-09 02:03:09 -08:00
TensorFlower Gardener
e56a210af7 Merge pull request #77208 from yhng3010:fix_label_image_cmake_cross_compile
PiperOrigin-RevId: 713582944
2025-01-09 01:50:21 -08:00
TensorFlower Gardener
aee2a07a19 Merge pull request #81920 from pasweistorz:fix-issue-70730
PiperOrigin-RevId: 713582940
2025-01-09 01:42:47 -08:00
A. Unique TensorFlower
76f426c436 Update GraphDef version to 2102.
PiperOrigin-RevId: 713575031
2025-01-09 01:27:51 -08:00
A. Unique TensorFlower
1fbc09a4a8 compat: Update forward compatibility horizon to 2025-01-09
PiperOrigin-RevId: 713575029
2025-01-09 01:18:55 -08:00
A. Unique TensorFlower
01abee87bb Automated Code Change
PiperOrigin-RevId: 713572893
2025-01-09 01:10:08 -08:00
A. Unique TensorFlower
2e14ee8986 Automated Code Change
PiperOrigin-RevId: 713571453
2025-01-09 00:58:05 -08:00
A. Unique TensorFlower
e17fbccc6d Automated Code Change
PiperOrigin-RevId: 713569059
2025-01-09 00:45:29 -08:00
A. Unique TensorFlower
02bdfbbca0 Automated Code Change
PiperOrigin-RevId: 713563161
2025-01-09 00:30:52 -08:00
A. Unique TensorFlower
c63676ecef Automated Code Change
PiperOrigin-RevId: 713561687
2025-01-09 00:16:36 -08:00
A. Unique TensorFlower
68ce340cf3 Automated Code Change
PiperOrigin-RevId: 713549118
2025-01-08 23:19:12 -08:00
A. Unique TensorFlower
938cd492a5 Automated Code Change
PiperOrigin-RevId: 713534685
2025-01-08 22:19:50 -08:00
Fergus Henderson
29a8da4448 Minor code simplification.
There is only one call to `TfLiteDelegateCopyFromBufferHandleInternal`,
which passes in `t` for the `tensor` parameter and `t->delegate` for the `delegate` parameter, so inside this function, `tensor->delegate` and `delegate` are equivalent expressions that evaluate to the same value.  But referencing `delegate` rather
than `tensor->delegate` is simpler and more readable here, and makes the nullness check match the dereference on the following line, and is more consistent with the other functions in this file.  So this change modifies the code to use `delegate`
rather than `tensor->delegate`.

PiperOrigin-RevId: 713528157
2025-01-08 21:52:15 -08:00
A. Unique TensorFlower
93a7459105 Automated Code Change
PiperOrigin-RevId: 713524368
2025-01-08 21:40:48 -08:00
A. Unique TensorFlower
c9d164add0 Automated Code Change
PiperOrigin-RevId: 713524077
2025-01-08 21:28:57 -08:00
Junwhan Ahn
7d91b32595 Fold xla::PjRtXlaLayout into xla::PjRtLayout for simplification
`xla::PjRtLayout` was designed as an abstract class so that it leaves options to represent layouts without depending on `xla::Layout`. In reality, `xla::PjRtXlaLayout` is the only concrete layout representation that will exist in the foreseeable future, and the lack of a proper type-erased layout creation interface forces everyone to use unsafe downcast to access the underlying layout. This causes an unnecessary code bloat without much extensibility because too many downcasts practically prevent new layout representations from being easily introduced.

This CL folds `xla::PjRtXlaLayout` into `xla::PjRtLayout` and make `xla::PjRtLayout` a non-abstract class. Like `xla::Shape` that is used pervasively in PjRt, this CL makes layouts a concrete type based on `xla::Layout`. The benefit is that it simplifies many callers that use PjRt layouts: `xla::GetXlaLayoutUnsafe()` is now replaced with the `pjrt_layout->xla_layout()` accessor, no more `down_cast`/`dynamic_cast` to access `xla::PjRtXlaLayout`, etc.

`xla::ifrt::BasicStringArrayLayout` was the only other implementation of `xla::PjRtLayout` and this is now removed. Since string arrays are supported only in IFRT and not in PjRt, its layout representation should also live only in IFRT. Since no one depends on string array layouts, this CL simply removes its implementation so that we can add a proper one once a proper IFRT layout type is added.

PiperOrigin-RevId: 713516368
2025-01-08 20:49:06 -08:00
A. Unique TensorFlower
fe57ee0492 Make PJRTArray::Create validate the create-request for addressable devices only.
PiperOrigin-RevId: 713512379
2025-01-08 20:33:05 -08:00
Niklas Vangerow
a28caef40a Add device_count accessor to HloRunnerInterface.
Also fixes hlo_runner_interface includes.

PiperOrigin-RevId: 713504316
2025-01-08 20:01:26 -08:00
Toli Yevtushenko
09ce373aca Refactor collective_permute decomposer. Extract general purpose collective permute related methods to a cp_utils.
PiperOrigin-RevId: 713493391
2025-01-08 19:03:20 -08:00
Vamsi Manchala
35fbbd0aa7 Create option to allow tensorflow::Tensor objects to be imported as DenseResourceElementsAttr during TF V1/V2 saved models import to MLIR Module.
PiperOrigin-RevId: 713491382
2025-01-08 18:52:14 -08:00
A. Unique TensorFlower
ccaef81b5c Reverts changelist 546034127
PiperOrigin-RevId: 713458912
2025-01-08 16:58:43 -08:00
A. Unique TensorFlower
0ce1d6f397 [XLA:GPU] Make dnn_compiled_graphs as bytes. This can fix parsing errors from invalid utf-8 data.
PiperOrigin-RevId: 713457611
2025-01-08 16:49:24 -08:00
Victor Stone
56e07952f3 Improve comment in ShapeUtil
PiperOrigin-RevId: 713456387
2025-01-08 16:39:43 -08:00
Andrew Zhang
aa290d76bb Fixed a bug where slice Op legalization constructing QNN param with slicing size instead of end index.
PiperOrigin-RevId: 713450306
2025-01-08 16:20:23 -08:00
TensorFlower Gardener
7886562dd6 Merge pull request #83753 from codinglover222:support_math_boolean
PiperOrigin-RevId: 713439997
2025-01-08 15:47:00 -08:00
A. Unique TensorFlower
ca5e5041a1 Silence Dlopen log messages when probing for Neuron library
PiperOrigin-RevId: 713429782
2025-01-08 15:12:22 -08:00
A. Unique TensorFlower
2fd9ba8f12 Remove redundant string conversions.
PiperOrigin-RevId: 713423758
2025-01-08 15:02:24 -08:00
A. Unique TensorFlower
df7525018e Fix application of JIT compiler plugins
1) Restore some key logic lost when landing cl/707770943, in compiled_model.cpp:122
2) Don't abort CompiledModel creation if the runtime fails to apply compiler plugins, rather issue warnings
3) Log the list of compiler plugins that were successfully applied

PiperOrigin-RevId: 713420589
2025-01-08 14:51:39 -08:00