D. E. Shaw Data Analytics Interview Questions & Answers

A bridge that lets the Service refresh data from on-premises sources securely on a schedule.

df = pd.read_csv('file.csv'); then head(), info(), describe() and isna().sum() for a quick health check.

It depends on margin of error, confidence level and expected variability; larger samples give smaller errors with diminishing returns.

DELETE removes chosen rows and can be rolled back; TRUNCATE empties the table quickly; DROP removes the table structure itself.

Data → Data Validation restricts what can be entered in a cell (lists, number ranges, dates), reducing manual entry errors in shared sheets.

Slicers are on-page visual filters users click; filters can be set at visual, page or report level and may be hidden from users.

ROW_NUMBER gives a unique sequence. RANK gives ties the same rank and skips the next (1, 1, 3). DENSE_RANK gives ties the same rank without gaps (1, 1, 2).

Links between tables on key columns; cardinality can be one-to-many, many-to-one or many-to-many, and cross-filter direction controls how filters flow.

Import loads data into memory for fast visuals; DirectQuery queries the source live, giving fresh data but slower performance and some DAX limits.

It evaluates an expression after modifying the filter context, for example CALCULATE(SUM(Sales[Amount]), Region[Name] = "North").

Compare with a control group or use difference-in-differences, control for seasonality, and measure incremental sales against campaign cost.

df['sales'].rolling(window=7).mean() gives a 7-period moving average, useful to smooth daily noise.

Check data pipelines first, then segment by channel, region, product and device, compare to the same period last year, and look for launches, outages or campaigns.

A Common Table Expression (WITH name AS (...)) is a named temporary result used inside one query. Use it to break complex logic into readable steps or for recursive queries.

COUNT counts numbers, COUNTA counts non-empty cells and COUNTIF counts cells meeting one condition; COUNTIFS handles several conditions.

Aggregate revenue by month, use LAG(revenue) OVER (ORDER BY month), then (revenue - prev) / prev x 100.

Use TRIM, CLEAN, UPPER or PROPER, Text to Columns, Flash Fill, SUBSTITUTE, and Power Query for repeatable cleaning steps.

It automatically formats cells based on rules such as colour scales, data bars or highlighting values above a target, making patterns visible at a glance.

Use RFM scoring or clustering on behaviour and value, validate segments with business teams and attach an action to each segment.

SUMIFS sums values meeting several criteria and is fast. SUMPRODUCT multiplies arrays and adds them, handling more complex conditions and weighted totals.

A pivot table summarises large data by dragging fields into rows, columns, values and filters — for example total sales by region and month — without writing formulas.

A Microsoft BI tool made of Power BI Desktop for building reports, the Service for sharing, and Mobile; it connects, models and visualises data.

Relative references change when copied (A1); absolute references stay fixed ($A$1); mixed references lock only the row or column (A$1 or $A1).

A function that calculates over a set of rows related to the current row without collapsing them, such as ROW_NUMBER, RANK, LAG or SUM() OVER (PARTITION BY ...).

pd.merge(df1, df2, left_on='cust_id', right_on='id', how='left') joins on differently named keys.

Mean for symmetric data without outliers, median for skewed data (salaries, house prices), mode for categories (the most common city).

It extracts and transforms data using recorded steps in M language, such as merging, unpivoting, changing types and removing errors, before loading to the model.

Bookmarks save a report view state for navigation; drill-through jumps to a detail page filtered to the item you picked.

Build PivotTables from a clean table, add PivotCharts and slicers, link KPIs with formulas, and refresh from Power Query so everything updates together.

A view stores a query and runs it each time; a materialised view stores the result physically and must be refreshed, making reads faster.

df['date'] = pd.to_datetime(df['date']); df['amount'] = pd.to_numeric(df['amount'], errors='coerce'); astype('category') for repeated strings.

Fix the root cause when possible, or wrap formulas with IFERROR or IFNA to return a clear fallback value.

A clustered index defines the physical order of rows (one per table); a non-clustered index is a separate structure with pointers to the rows.

Start from the business questions, show 4–6 top KPIs with trend vs target, allow drill-downs, keep colours consistent, remove clutter, add time/region filters and give one clear insight per visual.

Use a star schema, remove unused columns, prefer measures, reduce visuals per page, limit high-cardinality fields and use aggregations or incremental refresh.

SUM(amount) OVER (ORDER BY order_date ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW) adds up values cumulatively.

It adds conditional logic inside queries, for example bucketing ages or flagging values, returning different results per condition.

LEFT JOIN customers to orders and keep rows where order_id IS NULL, or use NOT EXISTS, which also handles NULLs safely.

melt converts wide data to long format; pivot converts long data to wide, and they are used to reshape data for analysis or charts.

Detect with IQR or z-score, then cap with clip, remove, transform with log, or keep and flag them depending on whether they are errors or real events.

The population is the whole group of interest; a sample is a subset used to estimate population values.

A report is multi-page and interactive from one dataset; a dashboard is a single-page canvas of pinned tiles from many reports in the Service.

IF returns one result if a test is true and another if false. Nest IFs for multiple outcomes, or use IFS for cleaner formulas.

Understand why it is missing, consider imputation or a missing flag, test sensitivity, and talk to data owners about fixing collection if it is systematic.

WHERE filters rows before grouping. HAVING filters groups after GROUP BY and can use aggregates like SUM() or COUNT().

Organising tables to reduce redundancy and anomalies by splitting data into related tables, commonly up to third normal form.

Profile the data, remove exact duplicates using keys, impute missing values (mean/median/mode or a business rule), flag imputed rows and document every cleaning step.

Sort by date (newest first), then Data → Remove Duplicates on the key column — Excel keeps the first occurrence. Or use UNIQUE / a COUNTIFS helper column.

Goal Seek changes one input to hit a target output; Solver optimises with several variables and constraints, for example maximising profit under budget limits.

A table auto-expands, supports structured references, banded rows and slicers, and keeps formulas consistent as rows are added.

A primary key uniquely identifies each row in its table; a foreign key references another table's primary key to enforce relationships.

Use XLOOKUP or COUNTIF to flag missing items in each list, or merge them in Power Query with a full outer join and filter unmatched rows.

UNION removes duplicate rows and sorts internally; UNION ALL keeps every row and is faster.

VLOOKUP only looks to the right and breaks when columns are inserted. INDEX-MATCH looks in any direction and is robust. XLOOKUP is the modern option with exact match by default and left lookups.

NULL means unknown, so comparisons with = fail; use IS NULL, COALESCE for defaults and remember most aggregates ignore NULLs except COUNT(*).

INNER returns matching rows, LEFT keeps all left rows, RIGHT keeps all right rows, FULL keeps all rows from both, and CROSS returns every combination.

Pandas for data handling, NumPy for numerics, Matplotlib and Seaborn for charts, and openpyxl or SQLAlchemy for files and databases.

Pick metrics tied to a business goal that are measurable, actionable and owned by someone, and pair a lagging metric with a leading one.

Rules that restrict data per user role, for example sales managers seeing only their region, defined with DAX filters and assigned in the Service.

INNER JOIN returns only matching rows. LEFT JOIN returns every row from the left table and NULLs where the right table has no match — e.g. all customers, including those with no orders.

Matplotlib is the low-level plotting library with full control; Seaborn builds on it with attractive statistical charts and simpler syntax.

Create an engine with SQLAlchemy or a driver such as psycopg2, then run pd.read_sql(query, engine) to load results into a DataFrame.

Check histograms and skew(), then apply log, square-root or Box-Cox transforms, or use medians and robust statistics.

A result can be statistically significant yet too small to matter; always report effect size and business impact together with the p-value.

Grouping users by a shared start date or trait and tracking behaviour over time, for example monthly retention per signup month.

Use np.where for one condition, np.select for several, or df.apply with a function for custom logic.

Read the execution plan, add or fix indexes, select only needed columns, filter early, avoid functions on indexed columns, and replace correlated subqueries with joins.