Datasets are needed for practicing and learning most big data technologies. Here are few datasets that may be useful for ElasticSearch. It may be useful for other big data technologies as well.
Elastic.co Datasets
Below datasets are provided by elastic.co website:
Elasticsearch aggregations group and extract summaries out of your data.
Aggregations belong into four main families:
Bucketing
Bucketing aggregations build buckets (groups) and put documents into relevant bucket based on some criteria. Each bucket is associated with a key and a document criterion
Metric
Metric Aggregations compute metrics over a set of documents.
Two types:
Single value numeric metric aggregations (output single value)
An inverted index is a data structure that consists of a list of all unique words and list of the documents in which it appears. New documents are analyzed and then stored as inverted indexes, to allow very fast full-text searches.
New documents in Elasticsearch are analyzed and stored as inverted indexes for faster searching. While "text" fields are analyzed as part of the analysis process, "keyword" fields and other exact match type fields are stored as is.
Amazon Elasticsearch Service (Amazon ES) is an AWS managed Elasticsearch service on the AWS Cloud. Amazon ES delivers Elasticsearch’s APIs and real-time capabilities along with the availability, scalability, and security required by production workloads. Amazon Elasticsearch Service currently supports Elasticsearch versions upto 6.2.
Each account is limited to a maximum of 200 stacks. Can contact AWS for any changes. There are no limits to the number of templates.
CF Template, Parameter, Output, and Resource description fields are limited to 4096 characters.
NAT Gateways can auto scale upto 10 Gbps.
Flow logs per single network interface, single subnet, or single VPC in a region = 2
VPCs per region = 5
Elastic IP addresses per region = 5
DynamoDB is very important for clearing AWS Certified Developer Associate.
DynamoDB synchronously replicates data across three facilities in an AWS Region.
DynamoDB Streams captures a time-ordered sequence of item-level modifications in any DynamoDB table, and stores this information in a log for up to 24 hours.
Elasticache for redis support both single-node and up to 15-shard clusters are available, enabling scalability to up to 3.55 TiB of in-memory data.
For standard SQS queues, there can be a maximum of 120K inflight messages per queue. For FIFO SQS queues, max is 20K.
General Purpose SSD (gp2) EBS Volume - Ratio of 3 IOPS per GB upto 10,000 IOPS. Burst upto 3000 IOPS for volumes under 1GB.
Provisioned IOPS SSD (io1) EBS Volume - For more than 10,000 IOPS. Upto 20,000 IOPS per volume.
Please first use the contact form or facebook page messaging to connect.
Offline ContactComplete the form below, and we'll send you an e-mail every now and again with all the latest news.
CloudMaterials is my blog to share notes and learning materials on Cloud and Data Analytics. My current focus is on Microsoft Azure and Amazon Web Services (AWS).
I like to write and I try to document what I learn to share with others. I believe that knowledge is useless unless you share it; the more you share, the more you learn.
Recent comments