Thread
You're a team lead who's just back from a vacation.
In the first standup after you return, here's the conversation with your teammate (T):
Teammate(T): Hey, I am blocked since I don't have AWS access credentials for the last 2 days. I am unable to proceed with any work.
In the first standup after you return, here's the conversation with your teammate (T):
Teammate(T): Hey, I am blocked since I don't have AWS access credentials for the last 2 days. I am unable to proceed with any work.
You: Well, have you raised a request to get the credentials?
T: Yes, I already sent an email two days ago.
You: Okay, I'll get you the credentials. What do you need the credentials for, btw?
T: I need to write a bash script to backup some data and upload parts of it to S3.
T: Yes, I already sent an email two days ago.
You: Okay, I'll get you the credentials. What do you need the credentials for, btw?
T: I need to write a bash script to backup some data and upload parts of it to S3.
You: Okay, so how far along are you with the script?
T: I wasn't able to start, since I don't have the credentials.
You: Umm, why do you need credentials if you're writing the bash script. You can do this locally, no? And you can plug-in the S3 part later.
T: I wasn't able to start, since I don't have the credentials.
You: Umm, why do you need credentials if you're writing the bash script. You can do this locally, no? And you can plug-in the S3 part later.
T: I don't know. I need to log in to an EC2 machine to write the script. The backup file is only present on that machine.
You: Umm, can you download the backup file locally, write and test your script and then scp the script to the EC2?
T: No, the backup file is too big.
You: Umm, can you download the backup file locally, write and test your script and then scp the script to the EC2?
T: No, the backup file is too big.
You: How big?
T: 200+GB I guess
You: And, afaik, you're trying to extract the file, pick some folders from this file, massage some data and upload it to S3, right?
T: Yeah, kind of.
You: Ok, does the backup file have some fixed folder structure in it?
T: Yes
T: 200+GB I guess
You: And, afaik, you're trying to extract the file, pick some folders from this file, massage some data and upload it to S3, right?
T: Yeah, kind of.
You: Ok, does the backup file have some fixed folder structure in it?
T: Yes
You: Do you know the exact folder structure of the backup tar file? An output of `tree` command for example?
T: umm, I can find that out I guess.
You: And do you know which folders and files you want to extract and upload to S3?
T: Yes, But, where are you going with this?
T: umm, I can find that out I guess.
You: And do you know which folders and files you want to extract and upload to S3?
T: Yes, But, where are you going with this?
You: So, you can
- simulate a similar folder structure locally,
- create a dummy tar file,
- pass the tar as input to your script, and
- develop and test your script LOCALLY.
T: Umm, I guess I can. But why can't I just get credentials for AWS?
- simulate a similar folder structure locally,
- create a dummy tar file,
- pass the tar as input to your script, and
- develop and test your script LOCALLY.
T: Umm, I guess I can. But why can't I just get credentials for AWS?
You: 😒😒😒
_some time passes_
You: Let me teach you how things work in real world.
_some time passes_
You: Let me teach you how things work in real world.
You: I'll get you the creds for sure, but first, you need to learn to break your work into dependencies that you're absolutely blocked on and things you can (and should) still do, without being blocked.
You: In this case, you can still proceed with writing the script with dummy data, locally, without any dependency.
You can also add lines to upload data to S3 (comment these out for now).
Accept the credentials from an env variables in your script. Handle error scenarios, etc..
You can also add lines to upload data to S3 (comment these out for now).
Accept the credentials from an env variables in your script. Handle error scenarios, etc..
You: Only when the time comes to deploy your script on prod, you need the credentials. Not before.
Learn to develop scripts and programs locally, in isolated manner.
Some mandatory reading:
- The Goal book (understand system constraints)
- Queuing theory (how to schedule work)
Learn to develop scripts and programs locally, in isolated manner.
Some mandatory reading:
- The Goal book (understand system constraints)
- Queuing theory (how to schedule work)
I repeat this and similar advice countless times. So, I wrote this. Next time, I can point people to this thread.
The story here isn't made up, I have exaggerated a few things for dramatic effect, but it's pretty much a real-world story. Let me know if you relate to this.
The story here isn't made up, I have exaggerated a few things for dramatic effect, but it's pretty much a real-world story. Let me know if you relate to this.
Mentions
See All
visa is doing final edits (98%) ✍🏾📖 @visakanv
·
Mar 16, 2023
interesting thread articulating a scenario where an employee is blocked on a task when a workaround is possible what interests me is the degree to which the employee is or isn’t incentivised to do the workaround instead of basically using the block to take a ‘snow day’ or two