Senior consultant Interview Questions

There are two main answers to this question. Initially spark partitions data via the Hadoop input format when reading from its source. Subsequently, it partitions data according to the level of parellisim such that a single task can process that data. This level of parellisim can be over partition. The level of parellisim can be overridden by some functions on a per function basis.

I can attest that this is quite true. The company develops great products but it's disappointing how they treat their candidates that they themselves contacted - it speaks highly of the organisation's culture and values.

By describing end to end process including technologies used

Provided list of previous transformation clients, process, results and referees for each case

Seems to be a standard question they ask. I gave the "text book" answer and mentioned that having startup experience I did a lot of DevOps tasks myself like setup AWS EC2 instances, etc.

Yes. (But the question was asked by a guy with a heavy French accent and I had to have him explain the question twice, which I believe irritated him.)

This was financial cost system related so answers were around close of dates, accruals & reporting timeframes

It was a conversation based around how you would approach the situation - types of questions to establish and avenues for the client & consultant team to work on.