Skip to content

Commit

Permalink
Added required external components
Browse files Browse the repository at this point in the history
  • Loading branch information
fhennig committed Aug 10, 2023
1 parent 5aed035 commit f91ee02
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 2 deletions.
9 changes: 9 additions & 0 deletions docs/modules/druid/pages/required-external-components.adoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# Required external components

Druid uses an SQL database to store metadata. Consult the https://druid.apache.org/docs/latest/dependencies/metadata-storage.html#available-metadata-stores[Druid documentation] for a list of supported databases and setup instructions.

## Feature specific: S3 and cloud deep storage

https://druid.apache.org/docs/latest/dependencies/deep-storage.html[Deep storage] is where segments are stored. Druid offers multiple storage backends. For the local storage there are no prerequisites. HDFS deep storage can be set up with the xref:hdfs:index.adoc[Stackable Operator for Apache HDFS]. For S3 deep storage or the Google Cloud and Azure storage backends, you need to set up the storage.

Read the xref:usage-guide/deep-storage.adoc[deep storage usage guide] to learn more about configuring Druid deep storage.
6 changes: 4 additions & 2 deletions docs/modules/druid/pages/usage-guide/deep-storage.adoc
Original file line number Diff line number Diff line change
@@ -1,8 +1,10 @@
= Deep storage configuration

https://druid.apache.org/docs/latest/dependencies/deep-storage.html[Deep Storage] is where Druid stores data segments. For a Kubernetes environment, either the HDFS or S3 backend is recommended.

== [[hdfs]]HDFS

Druid can use HDFS as a backend for deep storage:
Druid can use HDFS as a backend for deep storage, which requires having an HDFS instance running. You can use the xref:hdfs:index.adoc[Stackable Operator for Apache HDFS] to run HDFS. Configure the HDFS deep storage backend in your Druid cluster this way:

[source,yaml]
----
Expand Down Expand Up @@ -80,4 +82,4 @@ include::partial$s3-note.adoc[]

=== S3 Credentials

include::partial$s3-credentials.adoc[]
include::partial$s3-credentials.adoc[]

0 comments on commit f91ee02

Please sign in to comment.