* fix titan open without cf
Signed-off-by: Connor1996 <zbk602423539@gmail.com>

* change c.h and c.cc for bindgen ffi
Signed-off-by: fredchenbj <cfworking@163.com>

- Update `rand` to v0.7
- Move `crc` to `dev-dependencies`
- Remove `byteorder`
- Replace `tempdir` with `tempfile`
Signed-off-by: koushiro <koushiro.cqx@gmail.com>

* Fix various unsafe declarations

As reported by clippy. These are all cases where a pointer argument is
dereferenced by a declared safe function. The functions are changed to be unsafe
functions. Though some of these functions are declared pub, they all seem to be
related to internal binding matters and appear to be written correctly, just
declared incorrectly, so there shouldn't be any external impact for callers
that aren't using the crocksdb API directly.
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Fix some clippy style lints
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Fix mutability of crocksdb_load_latest_options errptr

This value can be mutated on the C side. Caught by clippy.
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Cleanup some unit-return functions
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Disable a clippy lint
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* make a transmute more typesafe
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Elide a lifetime
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Remove unnecessary unsafe blocks
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Use repr(C) structs of c_void for opaque types.

These represent opaque RocksDB types. They are used behind pointers, but are
also wrapped in other types in the higher-level bindings.

These use the strategy for opaque C types described in the nomicon [1]:
but with the exception that they contain c_void instead of [u8; 0], thus
making them uninstantiable sized types instead of ZSTs.

The c_void documentation publicly recommends using the ZST pattern from the
nomicon, but in private documentation [2] warns about UB from dereferencing
pointers to uninhabited types, which these bindings do.

Additionally, these bindings wrap some these types directly (not through
pointers) and it's impossible to repr(transparent) a ZST, without which the
unsafe casts within are dubious.

[1]: https://doc.rust-lang.org/nomicon/ffi.html#representing-opaque-structs
[2]: https://doc.rust-lang.org/nightly/src/core/ffi.rs.html#28Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Apply repr(transparent) to various unsafe-cast wrappers

These are wrappers of opaque FFI types, and pointers are being unsafely cast
between the two. repr(transparent) is probably needed to make this well-defined.
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Replace mem::transmute with pointer casts

Slightly more typesafe, and more explicit about what's being cast.
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Replace more mem::transmute with casts
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Remove a no-op mem::transmute
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Remove is_power_of_two

std contains a branchless bitmagic version of this function
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Add clippy makefile target
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Add clippy to CI
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Fix types in memcpy

This code is copying from c_void pointers when it should be copying
from byte pointers.

Fortunately c_void and u8 have the same size, but I don't know if that is
guaranteed.
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Update src/rocksdb.rs
Co-Authored-By: kennytm <kennytm@gmail.com>
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Install clippy on travis
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Adjust clippy lints for CI toolchain
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* Make a typesafe cast
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* rustfmt
Signed-off-by: Brian Anderson <andersrb@gmail.com>

Found via valgrind.
Signed-off-by: Brian Anderson <andersrb@gmail.com>

* fix titan cf options for create_cf
Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Signed-off-by: sre-bot <sre-bot@pingcap.com>

Signed-off-by: Little-Wallace <bupt2013211450@gmail.com>

Update rocksdb to include the following changes:
```
d9ac7463e 2019-10-29 yiwu@pingcap.com     Cherry-pick compile error fixes (#129)
8a63fcbfe 2019-10-29 yiwu@pingcap.com     Fix OnFlushCompleted fired before flush result write to MANIFEST (#5908) (#127)
```
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Improve documentation.
Signed-off-by: loxp <loxppqqxol@gmail.com>

* add update titan script
Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Update rocksdb and titan with the following changes. The main change is to fix Titan missing blob file issue.
rocksdb:
```
9ab5a5f9e 2019-10-15 yiwu@pingcap.com     Make WaitForFlushMemTable public (#126)
```

titan:
```
0a3f87a 2019-10-15 yiwu@pingcap.com     Temp fix for data loss caused by concurrent flush (#96)
8ac5003 2019-10-16 zbk602423539@gmail.. merge BackgroundGC with TEST_StartGC (#94)
b9915d9 2019-10-07 zbk602423539@gmail.. check nullptr (#91)
280b59d 2019-09-27 yiwu@pingcap.com     Adjust daily benchmark script (#84)
```
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Signed-off-by: Little-Wallace bupt2013211450@gmail.com

Add interface to get count of each write stall reason.

Upgrade RocksDB to 6.4.x. Also updating titan master.
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Add OnBackgroundError handler API. 

For the API, also adding crocksdb_status_ptr_t struct, which may be later extend to allow setting a different status (since rocksdb OnBackgroundError allow overriding the background error).
Signed-off-by: Yi Wu <yiwu@pingcap.com>

Setting `WITH_TESTS=OFF` and `WITH_TOOLS=OFF` explicitly. Since we specify target explicitly, even without setting these flags we don't really build rocksdb tests and tools. But still, let's set it anyway to make sure.

Closes #344 

The option is useful for catching LSM tree corruption. Adding it.
Signed-off-by: Yi Wu <yiwu@pingcap.com>

* add get blob cache usage
* add get and set blob cache capacity
Signed-off-by: Connor1996 <zbk602423539@gmail.com>

Signed-off-by: Little-Wallace liuwei@pingcap.com

Cherry-Pick pingcap#338 to master

Signed-off-by: qupeng <qupeng@pingcap.com>

* fix memory allocator

Adding LRUCacheOptions::set_no_dump_allocator, so we can use JemallocNoDumpAllocator of rocksdb to exclude some LRU Cache, like block cache, from core dump.