v0.6.2

Summary

• Support mixed precision on keras-core on all of jax, torch and tensorflow.
• Add keras_nlp.layers.RotaryEmbedding for rotary embeddings.
• Add keras_nlp.layers.ReversibleEmbedding to better support tied or untied weights for logit projections.
• Many bug fixes and improvements.

What's Changed

• Generic RotaryEmbedding Layer by @shivance in #1180
• Raise ValueError when number of dims evaluate to zero by @sampathweb in #1198
• Add XLNetBackbone by @susnato in #1084
• Switch from tf.nest to dm-tree by @mattdangerw in #1199
• Fix CI for keras-core 0.1.4 by @mattdangerw in #1202
• Fix ModuleNotFoundError keras_nlp.models.xlnet by @shivance in #1204
• Add support for "untied" embedding weights in language models by @mattdangerw in #1201
• Add start_index argument to all position embedding layers by @mattdangerw in #1209
• Remove windows line endings by @mattdangerw in #1210
• Fix Autograph error with perplexity metric by @shivance in #1211
• [JAX backend]: Fix errors with perplexity by @shivance in #1213
• Improve layer naming consistency by @mattdangerw in #1219
• Stop asserting key order in bart preprocessor by @mattdangerw in #1221
• Remove file level docstrings by @mattdangerw in #1222
• Fix typos by @mattdangerw in #1220
• Typo fix by @mattdangerw in #1223
• Fix RotaryEmbedding import by @shivance in #1217
• Update transformer_decoder for the proper naming of the sublayers. by @qlzh727 in #1230
• Replace tf with numpy by @mattdangerw in #1232
• Update to always using ops.shape by @mattdangerw in #1231
• Add a test harness based on keras-core's run_layer_test by @mattdangerw in #1238
• fixed token_to_id doc + error msg by @jackd in #1240
• Changed default TokenAndPositionEmbedding initializer to 'uniform' by @jackd in #1237
• Add compat shims for the upcoming keras-core release by @mattdangerw in #1244
• Depend on latest keras-core by @mattdangerw in #1246
• Removed the undefined self.sequence_length by @sahusiddharth in #1245
• Bump devcontainer to 3.9 by @mattdangerw in #1249
• Add a mixed precision test and fix mixed precision errors for layers by @mattdangerw in #1242
• Quick fix for 0.1.7 keras-core release by @mattdangerw in #1251
• Small docstring fixes for the upcoming release by @mattdangerw in #1253

New Contributors

• @qlzh727 made their first contribution in #1230
• @jackd made their first contribution in #1240
• @sahusiddharth made their first contribution in #1245

Full Changelog: v0.6.1...v0.6.2