Using kafka-python: from kafka import KafkaConsumer if __name__ == ‘__main__’: topic_name=”example-topic” consumer = KafkaConsumer(topic_name, auto_offset_reset=”earliest”, bootstrap_servers=[‘kafka2:9092’], api_version=(0, 10), consumer_timeout_ms=1000) for msg in consumer: print(msg.value) if consumer is not None: consumer.close() from time import sleep from kafka import KafkaProducer # publish…
Each time you add an object to s3, a single individual object like one file that counts as a single request So if you drag and drop 100 files it is 100 requests If runs a loop and individually sends…
You need to add events to your functions. Have a read through the serverless documentation for events. Currently serverless supports lambdas to be invoked by API GateWay, Kinesis, DynamoDB, S3, Schedule, SNS, and Alexa Skill. (read more) So in this…
Ok I managed to fix this issue. You have to remove profile from provider and other .tf files files. So my main.tf file is – provider “aws” { region = “${var.region}” } terraform { required_providers { aws = { source…
You shouldn’t use the Amazon API directly from your app, because in that case you would need to distribute your AWS access key & secret with the app. (I’ll let you figure out why this would be bad thing) You…
AWS’s EC2 service runs mostly on Linux servers, nearly a half-million of them according to the article below. They are running a modified version of the Xen hypervisor. 1 solved Do amazon ec2 linux instances run on VMWare?
In R it is always preferable to avoid loops wherever possible, as they are usually much slower than alternative vectorized solutions. This operation can be done with a data.table join. Basically, when you run dt1[dt2]; you are performing a right-join…
You can upload a file to an S3 pre-signed URL using curl: curl -T dog.png “<pre-signed url here>” Yes, the bucket needs to exist in advance. No, you don’t need additional credentials. 7 solved How to upload docs to signed…
No way, it will only send email: Amazon Simple Email Service (Amazon SES) is a cost-effective outbound-only email-sending service 3 solved How to set up Amazon SES to send and receive emails [closed]
I got past that problem. What did I do? I had previously been able to ssh into remote machines from a dos shell because I had the PATH environment variable pointing to my %CYGWIN%/bin directory. That’s handy but it also…
You can configure the same via virtual host in httdp.conf with redirection rule or you can do the same with ELB in which you can mention the request comes on 80 and ELB will forward the same on 8000 port.…
This would depend upon the speed of your Internet connection. While AWS might throttle your access to the service, your Internet connection is likely to be the biggest bottleneck. The best way to know is to upload some data (eg…
You need require some credentials, AWS Elastic Beanstalk needs the following information to deploy an application: AWS access key ID AWS secret key Service region Application name Environment name Solution stack Here is the complete reference link 2 solved How…
Well, not sure I fully understand what you are trying to do, but if you have ‘main’ and ‘admin’ running on two separate servers (behind elastic IP), you can easily create main.example.com and admin.example.com by adding example.com nameservers to Route53…
Here’s some code that retrieves a list of instances and count the number of stopped and running instances: import boto3 def lambda_handler(event, context): ec2_resource = boto3.resource(‘ec2’) instances = [instance.state[“Name”] for instance in ec2_resource.instances.all()] print(‘Running: ‘, instances.count(‘running’)) print(‘Stopped: ‘, instances.count(‘stopped’)) The…