Release notes
July 23rd, 2024
Improvements
- Updated View Gallery to include examples for popular Python charting libraries.
Bug Fixes
- Consolidated browser access patterns, implementing a 512 MB limit for web-based downloads of individual files. To access larger files, clone the repository locally or use read-only mount or lazy clone to access a subset of files.
- Fixed an issue where selecting the search bar on the Explore page redirected users to a repository instead of letting them enter a query.
- Resolved an issue where built-in views were not working in repositories without a
/.xethub
directory. - Removed redundant view for 3D Viewer-supported file types.
July 16th, 2024
New Features
- Submit suggestions or share general comments about the platform with the new
Share feedback
button available from the main navigation bar.
Improvements
- Netron, 3D Viewer, and NGL Viewer are now built-in views, available automatically for all supported file types.
- Added Decision Tree example to the View Gallery.
- Added documentation providing best practices for integrating XetHub repositories with other Git remotes.
Bug Fixes
- Fixed a regression in pull request behavior where requesting changes incorrectly marked changes as approved.
July 9th, 2024
New Features
- Create custom views with a single line using templates from our new View Gallery or create your own inheritable templates.
Bug Fixes
- Resolved issue with
xetview
library functionsget_data_urls()
andget_data()
supporting in-browser Python custom views not returning file data when viewing as a logged out visitor.
July 2nd, 2024
New Features
- Write and run Python code directly in the browser to create visualizations, summaries, and more on your repo contents. This feature leverages JupyterLite and Pyodide for easy edits and iteration. Learn more.
Improvements
- Redesigned repo creation flow to include options for automatic import and integration.
- Improved documentation for Git repo migration and S3 import.
Bug Fixes
- Fixed issue with AWS S3 import using the XetHub UI where imports would silently fail; imports will now complete successfully.
June 28th, 2024
Bug Fixes
- Bug fixes for
git xet repo migrate
command. - Xet CLI bug fixes for the importing from AWS S3 bucket to XetHub repo feature.
- Xet CLI bug fixes for memory usage when uploading many large files.
June 18th, 2024
- Fixes and improvements to
git xet repo migrate
. - Improved Git-Xet and Xet CLI error messages for common issues.
June 11th, 2024
- Improvements and bugfixes to the repo migration tools.
git xet repo migrate
continues to improve! - Fix for the packaged
xet
command line failing on Windows. - Correct progress reporting for downloading files using
xet cp
. - Other small bugfixes and usability improvements.
May 21st, 2024
- Updated the subscription plan and added 14 days of free trial for all users.
- Added HSTS to our server side communication path and multiple improvements to provide more resilient service.
- Support multiple data sources for custom views.
May 14th, 2024
- We improved our data storage algorithms to include significantly better compression, so expect to see transmission and storage savings for new data in your repository.
- We know that importing repositories into XetHub has been difficult, and we now have a full solution. With the new
git xet repo migrate
command, you can easily import GitHub or any other Git repositories into XetHub, keeping all history and seamlessly importing any data stored in Git LFS. - A few other stabilization improvements and bug fixes.
April 23rd, 2024
- We heard your comments about the current onboarding process being rough and have made it much smoother with a 1-click install process. You are now able to copy-paste a single command which will install git-xet as well as log you in with a PAT token.
- We are stepping up our investment in compute with enhancements for custom views, and action workflows. You will see many more examples like the Tabular Data Summary demonstrating this new functionality by summarizing tabular file formats like csv, tsv, parquet, and more.
March 20th, 2024
- To cut down on data transfer cost and time, all data to and from CAS is now LZ4 compressed in transit
- Beta Feature: S3 read-only access for xet repos. Use the
--s3
option when runninggit xet login
to enable this.
March 6th, 2024
- Improve file deduplication across repository
January 25th, 2024
- Enhanced security for git-xet client through new CAS protocol client
January 9th, 2024
- We greatly improved git-xet filter speed for better performance on large repos.
- Some UI updates on XetHub.
December 13th, 2023
- Various bug fixes across client & website
- Fix 500 error on repo page
- Fix shard corruption issue in git-xet
December 5th, 2023
Xet Release Highlights:
- Data Mastery: Row counts in CSVs and improved handling of large CSVs are now available! Plus, file synchronization now uses a server-only smudge query policy for increased efficiency.
- UI Enhancements: Easily access features with the new button in Cuddlefish views and enjoy better alignment in text displays. Have CSVs with many columns? No problem, thanks to the overflow-x feature for scrolling. Also, documentation has been updated for easier navigation. Did I forget to mention? Dark mode gets a facelift with specified facet/header colors.
- Behind-the-Scenes Updates: Now ignoring Redis-generated files in .gitignore and featuring improved logging.
Enjoy these updates, designed to make your Xetea experience even more seamless and enjoyable!
November 14th, 2023
- Feature improvements to lazy cloning features to enable workflows with very large repos.
- Speed improvements for git-xet client integrations.
November 7th, 2023
- We know you Xetters love your different file formats! We have heard your cries and have added support for Netron models rendering in this release.
- There is a fix for backward compatibility on the generated summaries for large files.
October 31st, 2023
- Improvements to S3 sync user interface.
- Various bug fixes.
October 24th, 2023
- Bug fixes/improvements for GitHub integration:
- Include links for file preview in commit-level comments as a workaround for “Unable to render rich display” error for image files
- git-xet client changes to improve repo init process for GitHub repo
- Compute V1: enable the feature in prod
- Xetea: updated repo fork page with clearer UI/instructions for private fork
October 20th, 2023
- The beta version of our GitHub App has soft launched. Use the git-xet client with a repo stored entirely in GitHub.
- Our commitment to quality continues with a number of client improvements. We've buttoned up a few issues around repo initialization, forking, and performance across pull requests.
October 10th, 2023
- High Availability for XetHub: We have horizontally doubled the service size to make XetHub more stable.
- Users can now create new repositories on XetHub by importing from an AWS S3 bucket and have their repository periodically updated with changes from the bucket.
- The quick start guide has been polished to provide a better onboarding experience.
- More features have been added to the git-xet clients, including lazy clone, upgrade check, and xet URL support.
- Multiple bug fixes and UX improvements have been implemented.
September 22nd, 2023
- Bugfix for syncing issue for older, large repos.
- Added repo-independent smudge command to allow files to be materialized independent of a repo.
- Updated error codes for better internal diagnostics.
September 8th, 2023
- 🐛 Content deduplication bug fix
August 31st, 2023
- 🐛 File path fixes for the windows client
- 🐛 UX recent updates and Terms-of-Service
- 🏎️ Improved performance with caching and better deduplication
- ✨ Handle missing configuration
- ✨ Logging for deduplication messages
- ✨ Updates to documentation
August 7th, 2023
- 💡 Try Capsules now!
- ✨ Updates to documentation.
- 🎨 UI improvements & fixes.
July 6th, 2023
- Support for 10TB+ repositories now available.
- Easily create a duplicate repository from another. Read the documentation for more details.
- Monthly subscription summaries are now available in the
Subscription
tab of yourProfile
options. This feature is active for users who have billing enabled.
June 8th, 2023
- Usage measurements are now displayed under repo settings for users who have billing enabled.
- UI improvements, a few bug fixes, and stability improvements.
May 11th, 2023
- Downloading git-xet on for Linux Ubuntu/Debian users is smoother than ever with our new .deb installer.
- We've improved large repository downloads.
- Minor UX fixes.
- Updated documentation on how to upgrade git-xet versions.
April 4th, 2023
- Faster page loads with file pagination.
- Simpler git-xet HTTPS login authentication with fewer steps, as an alternative to SSH.
March 6th, 2023
- Windows Defender won't erroneously quarantine git-xet cache files. No more annoying warnings!
- We've improved our documentation so that it is easier to follow.
February 15th, 2023
- Git-Xet is now supported on Windows! Install our preview release now to see how Xet deduplication can speed your Unity and Unreal development.
- Lots of bug fixes and doc improvements.
December 12th, 2022
- Various bug fixes and improvements.
- Git+SSH works with MacOS Ventura!
December 9th, 2022
Note: today's release notes come to you courtesy of ChatGPT:
- Get started with XetHub today and discover a world of tutorials and demos that will show you the incredible power of Xet!
- Now you can use
git xet mount
on RedHat Enterprise Linux with full support and confidence. - Our latest release delivers even better performance, so you can access your data faster than ever before. Try it out and see the difference for yourself!
- We've squashed lots of bugs, so you can enjoy a smooth and seamless experience.
December 7th, 2022
- Git-xet has significant performance improvements! Mount a repository without downloading everything!
- xethub.com has a newly updated interface optimized for fast exploration of data files!
- 📈 Charts! All the charts! Custom vega-lite visualizations!
- Data visualizations on diff / commits! See outliers instantly!
October 17th, 2022
- Some customers were blocked from using XetHub because their firewalls were blocking access to higher port ranges. We have a workaround with this release where only ports 443 and 5000 are used by XetHub.
- We benchmarked and fixed a connection creation performance fix which should benefit our Mac users with a ~15% latency reduction for clone operations.
- We benchmarked and checked in a caching improvement in our usage of git notes which should improve the number of times we need to serialize and deserialize objects into git notes.
October 3rd, 2022
- We know you Xetters love your different file formats! We have heard your cries and have added support for Jupyter Notebooks and PDF rendering in this release.
- Nobody likes large datasets more than us. We have added better tools and support for large files and directories.
- In addition, our commitment to squeezing the last bit of compression continues as we continuously tweak our chunking algorithms.
August 25th, 2022
What's New:
- Continuing with our dedication to provide first-class tools for our data lovers, we've added summarizations for CSV files, the most popular data format. You'll get the benefit of snapshot views of your unstructured data files at the drop of the hat. The best part is that you don't even have to change anything in your workflow to make use of this killer feature. Just git add those CSVs like you normally would, and you'll have the summaries ready for you on xethub.com.
- Our commitment to quality and the world class performance continues with this release. This version of xet-tools a number of bug fixes and more than a few performance improvements, so you'll be unblocked from checking in and uploading your gigs and gigs of data within just a few minutes.
- XetHub.com is now live! Available in Private Beta - so you can sign-up for XetHub and we will onboard you. With xethub.com launched, you can be assured that your data stored in XetHub will be cared for. We are still crafting our service-level agreement, but we are uncompromisingly committed to keeping your data safe.
- We also launched xetdata.com with a fresh new look! Now you can meet the team behind XetHub. For those of you who want to join the XetData team, you can now see some of our current job openings. We would love to hear from you if you are interested!
Other Notes:
- With this release, we have removed the previously deprecated xet command line. You no longer have to worry about accidentally running the old command.
July 21st, 2022
- In this release we improve how we handle repos with many small files. MerkleDB better organizes them to optimize transfer & storage. With these changes you should experience even better performance when pushing & pulling your favorite XetHub repos.
- Thanks to our glorious users we fixed a user-reported bug (#10), so now forking a XetHub repo works again. Grab your knife & fork away!
June 30th, 2022
What's New:
- Introducing git-xet, a powerful new member in our family of tools! git-xet merges the power of xet with the familiarity of git, bringing you the best of both worlds. We can't wait for you to you to learn all about how beautifully powerful git-xet is!
- git-xet now bestows git with the power of XetHub's powerful deduplication engine. You'll see your data changes shrink to just the bytes you changed in your files, so you won't be punished by making only a teeny-tiny edit.
- Our integration with git is seamless. In fact, you won't have to decide whether to track a file with us or not. We make the decision and do the work for you, so you can focus on your important tasks instead of which files you want deduplicated.
- Not only does everything on your machine look & feel natural (you are just using git as you normally would), but you'll feel right at home with XetHub. Start a Pull Request, File an Issue, create Projects, Milestones, and Releases. All the things you expect to do with code, but now you can do it with code+data together.
- Our unending devotion to delivering world class performance continues with git-xet as well. Clones, push and pull your huge, juicy repos with abandon. It's all lightning fast!
xet CLI v0.5.0 - Deprecated!
- xet CLI is now deprecated, please use git-xet going forward. It is better in every way as it deeply integrates with git. You no longer need to use the xet CLI. If you encounter issues using the xet CLI to migrate your older xets to using git-xet, please contact us at support@xetdata.com.
May 19th, 2022
What's New:
- Starting today, you'll have the ability to pull a trace to send along to your favorite XetData Engineer. Run the xet with
-v -l logfile
to write out your debug information tologfile
, send us your logfile, and we'll fix your issue as quickly as possible. - Our dedication to providing world class performance has continued this release with a speed up to xet downloads and pushes. You'll spend less time waiting and more time diving into your delicious data.
Bug Fixes:
- Some of our early adopters may have seen some download failures because some of our naughty xets were not pointing at the right backend. Sorry about that! This is now fixed, so you'll never have to worry about that ever again.