PySpark.inData Engineering

Privacy Policy

Last updated: September 23, 2026

PySpark.in ("we", "us", "our") operates the website https://pyspark.in (the "Service"), a free platform offering Data Engineering, Apache Spark, SQL, Python and AI tutorials, coding challenges, an online compiler, blogs and certifications. This Privacy Policy explains what information we collect, how we use it, and the choices you have. By using the Service you agree to this policy.

1. Information We Collect

  • Account information. When you sign in with Google, we receive your name, email address and profile photo to create and personalise your account (progress, XP, streaks, certificates).
  • Usage data. Pages visited, challenges attempted, code you run and submit, and general interaction data used to operate leaderboards, track progress and improve the Service.
  • AI feature use. When you use an AI feature, the content described under "Groq" in section 4 is sent to our AI provider. For AI Coach we also record which feature you used, on which challenge, and whether it succeeded. For AI Coach and the AI tutor we keep a daily count of your requests, linked to your account email and the date, to enforce daily limits.
  • Device & log data. IP address, browser type, device information and timestamps, collected automatically by our servers and analytics for security and reliability.
  • Cookies & similar technologies. See the Cookies section below.

2. How We Use Your Information

  • To provide, maintain and personalise the Service (your dashboard, progress, certificates).
  • To operate features such as leaderboards, streaks, email reminders and notifications.
  • To display advertising and measure its performance.
  • To secure the Service, prevent abuse and rate-limit misuse.
  • To provide AI features you choose to use.
  • To communicate updates you have opted into (e.g. new-challenge alerts) — you can unsubscribe anytime.

3. Cookies and Advertising

We use cookies and similar technologies to keep you signed in, remember preferences and understand usage.

  • Google AdSense. We use Google AdSense to show ads. Third-party vendors, including Google, use cookies (such as the DoubleClick cookie) to serve ads based on your prior visits to this and other websites.
  • Google's use of advertising cookies enables it and its partners to serve ads based on your visits to our Service and/or other sites on the Internet.
  • You may opt out of personalised advertising by visiting Google Ads Settings, or opt out of third-party vendor cookies at www.aboutads.info/choices.
  • For more on how Google uses data when you use our partners' sites or apps, see Google's policy.

4. Third-Party Services

  • Google (Sign-In, Analytics, AdSense) — authentication, analytics and advertising.
  • Razorpay — to process payments for optional paid features (e.g. reference-solution unlocks). Payment card details are handled by Razorpay and are never stored on our servers.
  • Email delivery — to send transactional and opt-in emails.
  • Groq, Inc. (AI features) — generates the responses for our AI features. Each feature sends different information and has different safeguards:
    • AI Coach — sends the public text of the challenge you are on, a hint you have revealed if you ask about one, and your question. It sends your code or the error or result you saw only if the Coach offers that option and you tick the box to share it. Before sending, AI Coach replaces text in what you write that looks like email addresses, passwords, keys, tokens, connection details, IP addresses or internal host names. This cannot catch everything, so please don't include personal or secret information. AI Coach never sends your name, email address, account identifiers or sign-in tokens, and never sends hidden tests or reference solutions.
    • AI tutor ("Explain my error" and "Review my solution") — sends the challenge's title and description, an example expected output, and the code and output in your editor. It does not remove personal or secret information from your code or output, so please don't include any. It does not send your name or email address.
    • AI code assistant (the AI assistant in the online compiler, and the "Explain" buttons on code samples in tutorials and interview questions) — the compiler's assistant sends the request you type, including any code you paste into it; an "Explain" button sends that code sample. It does not remove personal or secret information, so please don't include any. It does not send your name or email address.
    • AI quiz — our server sends the title and text of the public tutorial you are reading. Nothing about you is sent.
    Under Groq's published terms, Groq does not use this data to train its models (we have not given it permission to), and does not retain it except for up to 30 days where needed to troubleshoot errors or investigate abuse. We currently use Groq for all AI features; if we add or change an AI provider, we will update this policy first.

These providers process data under their own privacy policies.

5. Data Retention & Security

We retain account and progress data while your account is active. We use reasonable technical and organisational measures to protect your data. No method of transmission or storage is 100% secure.

AI features: daily request counts for AI Coach and the AI tutor are kept with your account data. We do not save the questions, code or AI responses from AI Coach, the AI tutor or the AI code assistant in our database; our server logs record only technical details such as the feature used, timing, token counts, response size and error messages. AI Coach keeps an answer in server memory for a short time so that a repeated request is not sent twice (up to 24 hours for a general concept explanation, which contains nothing you wrote). Generated AI quizzes are stored and shown to everyone who opens that tutorial; they are made from public tutorial text and contain no personal information.

6. Your Rights & Choices

  • Access, update or request deletion of your account data by contacting us.
  • Opt out of marketing emails via the unsubscribe link or by replying "unsubscribe".
  • Control cookies through your browser settings and the ad-choices links above.

7. Children's Privacy

The Service is intended for users aged 16 and older and is not directed at children. We do not knowingly collect data from children.

8. International Users

Our servers are operated from India. By using the Service you consent to processing of your information in accordance with this policy.

AI features are processed by Groq, Inc., which is based in the United States, so content you send to an AI feature may be processed outside India.

9. Changes to This Policy

We may update this Privacy Policy from time to time. Material changes will be reflected by the "Last updated" date above.

10. Contact Us

Questions about this policy? Reach us via our Contact page or email pysparkteam@gmail.com.

See also our Terms of Service.