Signed-off-by: Little-Wallace <bupt2013211450@gmail.com>

Signed-off-by: Little-Wallace <bupt2013211450@gmail.com>

Signed-off-by: Little-Wallace <bupt2013211450@gmail.com>

Signed-off-by: Little-Wallace <bupt2013211450@gmail.com>

Update rocksdb to include the following changes:
```
d9ac7463e 2019-10-29 yiwu@pingcap.com     Cherry-pick compile error fixes (#129)
8a63fcbfe 2019-10-29 yiwu@pingcap.com     Fix OnFlushCompleted fired before flush result write to MANIFEST (#5908) (#127)
```
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Improve documentation.
Signed-off-by: loxp <loxppqqxol@gmail.com>

* add update titan script
Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Update rocksdb and titan with the following changes. The main change is to fix Titan missing blob file issue.
rocksdb:
```
9ab5a5f9e 2019-10-15 yiwu@pingcap.com     Make WaitForFlushMemTable public (#126)
```

titan:
```
0a3f87a 2019-10-15 yiwu@pingcap.com     Temp fix for data loss caused by concurrent flush (#96)
8ac5003 2019-10-16 zbk602423539@gmail.. merge BackgroundGC with TEST_StartGC (#94)
b9915d9 2019-10-07 zbk602423539@gmail.. check nullptr (#91)
280b59d 2019-09-27 yiwu@pingcap.com     Adjust daily benchmark script (#84)
```
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Signed-off-by: Little-Wallace bupt2013211450@gmail.com

Add interface to get count of each write stall reason.

Upgrade RocksDB to 6.4.x. Also updating titan master.
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Add OnBackgroundError handler API. 

For the API, also adding crocksdb_status_ptr_t struct, which may be later extend to allow setting a different status (since rocksdb OnBackgroundError allow overriding the background error).
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Setting `WITH_TESTS=OFF` and `WITH_TOOLS=OFF` explicitly. Since we specify target explicitly, even without setting these flags we don't really build rocksdb tests and tools. But still, let's set it anyway to make sure.

Closes #344 

The option is useful for catching LSM tree corruption. Adding it.
Signed-off-by: Yi Wu <yiwu@pingcap.com>

* add get blob cache usage
* add get and set blob cache capacity
Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Signed-off-by: Little-Wallace liuwei@pingcap.com

Cherry-Pick pingcap#338 to master

Signed-off-by: qupeng <qupeng@pingcap.com>

* fix memory allocator

Adding LRUCacheOptions::set_no_dump_allocator, so we can use JemallocNoDumpAllocator of rocksdb to exclude some LRU Cache, like block cache, from core dump.

* add delete files in ranges API for titan
Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Update rocksdb with fix:
```
849a8c0ae 2019-07-30 yiwu@pingcap.com     fix sign compare warnings
```
Signed-off-by: koushiro <koushiro.cqx@gmail.com>

`register_dep("Z")` correctly set the include path for zlib, but fail to set the path to libz.a. RocksDB cmake script expect libz.a be place under ${DEP_Z_ROOT}/lib, but libz-sys place it under ${DEP_Z_ROOT}/build. Fixed it.

Also added a test to make sure possible compression types are all linked.
Signed-off-by: Yi Wu <yiwu@pingcap.com>

On some platforms jemalloc-sys adds a prefix when building its jemalloc. Thus it is not suitable to use jemalloc-sys to provide a jemalloc in such platforms, otherwise this will lead to a link error.

Update rocksdb with the following changes:

7a03c83ed 2019-07-23 psergey@askmonty.org Fix MyRocks compile warnings-treated-as-errors on Fedora 30, gcc 9.1.1 (#5553)
f21404420 2019-06-19 yiwu@pingcap.com     Fix ingested file and direcotry not being sync (#96) (#99)

When jemalloc feature is on, add jemalloc-sys dependency and pass its lib path to rocksdb.

Tested on ubuntu with libjemalloc-dev uninstalled.
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Signed-off-by: Yi Wu <yiwu@pingcap.com>

Fixing perf context test failure with `cargo test -- --test_threads=1`. The test assume default perf level is `PerfLevel::EnableCount`, which apparently will affected by other tests.

Tested by running `cargo test -- --test_threads=1`.

Closing #318 
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Adding feature "jemalloc". When enabled, rocksdb "WITH_JEMALLOC" will be enabled. This does NOT affect whether jemalloc is use or not. Mostly it only affect how rocksdb calculate block cache size: if "WITH_JEMALLOC" is on, it will use `malloc_usable_size()` (size allocated by jemalloc) to calculate size of each entry of block cache, instead of the requested size of the allocation.

Tested by running `cargo build --features jemalloc -vv` and check rocksdb compile flags from the output.
Signed-off-by: Yi Wu <yiwu@pingcap.com>

This PR exports more options in RocksDB `BlockBasedTableOptions`, because we want to use [Partitioned Index Filters](https://github.com/facebook/rocksdb/wiki/Partitioned-Index-Filters#how-to-use-it).

There is an issue [cache_index_and_filter_blocks causes Get slowdown](https://github.com/facebook/rocksdb/issues/3961) in rocksdb, and we test the recommend `Partitioned Index Filters` in java JNI binding, it works well.

So i think these options should be exported to rust-rocksdb users too.

The rocksdb log in test case `test_partitioned_index_filters` as below:

```
  cache_index_and_filter_blocks: 1
  cache_index_and_filter_blocks_with_high_priority: 1
  pin_l0_filter_and_index_blocks_in_cache: 1
  pin_top_level_index_and_filter: 1
  index_type: 2
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x7ff4540060d0
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 8388608
    num_shard_bits : 4
    strict_capacity_limit : 0
    memory_allocator : None
    high_pri_pool_ratio: 0.000
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 4096
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 1
  use_delta_encoding: 1
  filter_policy: rocksdb.BuiltinBloomFilter
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 2
  enable_index_compression: 1
  block_align: 0
```

It looks working.

Thanks you for this great project.

Fix typo done in #312

Signed-off-by: Yi Wu yiwu@pingcap.com