forked from facebook/rocksdb
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'main' into dont-swallow-errors
- Loading branch information
Showing
402 changed files
with
13,852 additions
and
4,320 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| name: build-folly | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Build folly and dependencies | ||
| run: make build_folly | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| name: build-for-benchmarks | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - uses: "./.github/actions/pre-steps" | ||
| - name: Linux build for benchmarks | ||
| run: make V=1 J=8 -j8 release | ||
| shell: bash |
10 changes: 10 additions & 0 deletions
10
.github/actions/increase-max-open-files-on-macos/action.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,10 @@ | ||
| name: increase-max-open-files-on-macos | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Increase max open files | ||
| run: |- | ||
| sudo sysctl -w kern.maxfiles=1048576 | ||
| sudo sysctl -w kern.maxfilesperproc=1048576 | ||
| sudo launchctl limit maxfiles 1048576 | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| name: install-gflags-on-macos | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Install gflags on macos | ||
| run: HOMEBREW_NO_AUTO_UPDATE=1 brew install gflags | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| name: install-gflags | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Install gflags | ||
| run: sudo apt-get update -y && sudo apt-get install -y libgflags-dev | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| name: install-jdk8-on-macos | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Install JDK 8 on macos | ||
| run: |- | ||
| HOMEBREW_NO_AUTO_UPDATE=1 brew tap bell-sw/liberica | ||
| HOMEBREW_NO_AUTO_UPDATE=1 brew install --cask liberica-jdk8 | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| name: install-maven | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Install maven | ||
| run: sudo apt-get update -y && sudo apt-get install -y maven | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| name: perform-benchmarks | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Test low-variance benchmarks | ||
| run: "./tools/benchmark_ci.py --db_dir ${{ runner.temp }}/rocksdb-benchmark-datadir --output_dir ${{ runner.temp }}/benchmark-results --num_keys 20000000" | ||
| env: | ||
| LD_LIBRARY_PATH: "/usr/local/lib" | ||
| DURATION_RO: 300 | ||
| DURATION_RW: 500 | ||
| NUM_THREADS: 1 | ||
| MAX_BACKGROUND_JOBS: 4 | ||
| CI_TESTS_ONLY: 'true' | ||
| WRITE_BUFFER_SIZE_MB: 16 | ||
| TARGET_FILE_SIZE_BASE_MB: 16 | ||
| MAX_BYTES_FOR_LEVEL_BASE_MB: 64 | ||
| COMPRESSION_TYPE: none | ||
| CACHE_INDEX_AND_FILTER_BLOCKS: 1 | ||
| MIN_LEVEL_TO_COMPRESS: 3 | ||
| CACHE_SIZE_MB: 10240 | ||
| MB_WRITE_PER_SEC: 2 | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,14 @@ | ||
| name: post-benchmarks | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - uses: actions/[email protected] | ||
| with: | ||
| path: "${{ runner.temp }}/benchmark-results" | ||
| - name: Send benchmark report to visualisation | ||
| run: |- | ||
| set +e | ||
| set +o pipefail | ||
| ./build_tools/benchmark_log_tool.py --tsvfile ${{ runner.temp }}/benchmark-results/report.tsv --esdocument https://search-rocksdb-bench-k2izhptfeap2hjfxteolsgsynm.us-west-2.es.amazonaws.com/bench_test3_rix/_doc | ||
| true | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,10 @@ | ||
| name: post-pmd-steps | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - uses: actions/[email protected] | ||
| with: | ||
| path: "${{ github.workspace }}/java/target/pmd.xml" | ||
| - uses: actions/[email protected] | ||
| with: | ||
| path: "${{ github.workspace }}/java/target/site" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,25 @@ | ||
| name: post-steps | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - uses: actions/[email protected] | ||
| with: | ||
| path: "${{ runner.temp }}/test-results" | ||
| - uses: actions/[email protected] | ||
| with: | ||
| path: LOG | ||
| - name: Compress Test Logs | ||
| run: tar -cvzf t.tar.gz t | ||
| if: ${{ failure() }} | ||
| shell: bash | ||
| - uses: actions/[email protected] | ||
| with: | ||
| path: t.tar.gz | ||
| - run: |- | ||
| mkdir -p ${{ runner.temp }}/core_dumps | ||
| cp core.* ${{ runner.temp }}/core_dumps | ||
| if: ${{ failure() }} | ||
| shell: bash | ||
| - uses: actions/[email protected] | ||
| with: | ||
| path: "${{ runner.temp }}/core_dumps" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,5 @@ | ||
| name: pre-steps-macos | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - uses: "./.github/actions/pre-steps" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,18 @@ | ||
| name: pre-steps | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Setup Environment Variables | ||
| run: |- | ||
| echo "GTEST_THROW_ON_FAILURE=0" >> "$GITHUB_ENV" | ||
| echo "GTEST_OUTPUT=\"xml:${{ runner.temp }}/test-results/\"" >> "$GITHUB_ENV" | ||
| echo "SKIP_FORMAT_BUCK_CHECKS=1" >> "$GITHUB_ENV" | ||
| echo "GTEST_COLOR=1" >> "$GITHUB_ENV" | ||
| echo "CTEST_OUTPUT_ON_FAILURE=1" >> "$GITHUB_ENV" | ||
| echo "CTEST_TEST_TIMEOUT=300" >> "$GITHUB_ENV" | ||
| echo "ZLIB_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/zlib" >> "$GITHUB_ENV" | ||
| echo "BZIP2_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/bzip2" >> "$GITHUB_ENV" | ||
| echo "SNAPPY_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/snappy" >> "$GITHUB_ENV" | ||
| echo "LZ4_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/lz4" >> "$GITHUB_ENV" | ||
| echo "ZSTD_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/zstd" >> "$GITHUB_ENV" | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| name: setup-folly | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Checkout folly sources | ||
| run: make checkout_folly | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| name: build-folly | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Fix repo ownership | ||
| # Needed in some cases, as safe.directory setting doesn't take effect | ||
| # under env -i | ||
| run: chown `whoami` . || true | ||
| shell: bash | ||
| - name: Set upstream | ||
| run: git remote add upstream https://github.com/facebook/rocksdb.git | ||
| shell: bash | ||
| - name: Fetch upstream | ||
| run: git fetch upstream | ||
| shell: bash | ||
| - name: Git status | ||
| # NOTE: some old branch builds under check_format_compatible.sh invoke | ||
| # git under env -i | ||
| run: git status && git remote -v && env -i git branch | ||
| shell: bash |
Oops, something went wrong.