From a different side on this -- would you want one of your children's friends to teach your children about the Bible? In like kind, you too are young in the Lord. You're old enough (in the Lord, so that's your rebirthdate I'm referencing, not your physical age) to learn, but not yet old enough to teach.
Want help? Until you find a good Bible-believing church this will help. Go to eSword.net and start perusing what they have to offer. I recommend downloading a few Bible versions (and make sure it's "version," not "translations," because a version is biblical scholars going back to the earliest texts and coming up with the best word-for-word English variation of those words, while translations are just people taking already transcribed English versions and translating it to what they want it to say.) KJV, simply because it's been proven accurate and goes along with other Bible Aids. A version for your country, since American is our version of English (either American Standard Version or the New International Version), and, just because I can understand it too and it's also a good version, the English Standard Version. But, feel free to pick any other versions you like, or even an Interlinear version, so you can see the four gospels in some kind of chronological order.
And after downloading different Bible versions, also download some aids so you can see what Biblical Scholars see when they read the same verses you're reading. You have to go with Strong's Concordance, which does go with the KJV. (Strong was a scholar who took every word in the Bible, told what the original word was, how it was pronounced and what the meaning was, and then took it one more step and showed every instance of that word throughout the Bible. Cool, huh? So you can't get lost on a word.) And, then you'll want Webster's 1820 dictionary, just because the meanings of words have changed over the centuries (and some of the other recommendations I'm about to give you were men who lived even before that, so they don't talk like us and it's hard to understand them, unless you have that dictionary at the ready.) And then for commentators, I recommend Matthew Henry for devotional, John Gill for the nitty gritty (he goes through every phrase to tell you what it meant way back when), Adam Clarke for the what-does-this-mean-to-us-today stuff, and Adam Barnes for the put-it-in-context stuff. I call those guys my Dead Guys, because they're all dead yet still teach me what the Bible means far beyond what I could ever spend my life figuring out on my own. That's just so you can read any Bible book and understand it.
BUT, if you also like to do word studies, (like you just asked on what marriage is according to the Bible, so that would make a good word study for you), also download Nave's Topical Bible, which does give references for the big issue stuff of the Bible (like who the Father is, Jesus, the Holy Spirit, marriage, divorce, fellowship, church, angels, etc.) and Vine's Expository.
And don't freak, too much. It's not like you have to read all those at any given moment. It's just that studying the Bible is very daunting -- always -- and these are like having your traditional reference material nearby, for when you need it. (Like, I always have a dictionary near me, in case I don't know a word, but I only pull it out maybe once a month. I also have a thesaurus next to me, because I like to write. And I finally gave up on phone books, because that's even too old-school for em. lol It's not like I read the whole thing through in one sitting, but it's very handy when I need one.)
Better yet, once you download all that from eSword, your reference material is right on your computer to access whenever you can. (Hubby used to have all that and more in books. I can't imagine how messy that would be with young ones in the house like you have. He studied on a spare sofa, and had so many books around him, I couldn't get within five feet of him when he was in study mode. lol)
So, first you learn and then you'll be able to help others learn. If you want to help your friend, just send him all this, and he can download and study with all the help he needs. Then you helped and your partner isn't worried about an old relationship redeveloping.
And you both need fellowship, so find a good church. (Not to be confused with you and old boyfriend should go to the same church, since that too will bother your partner.) There are many out there, but since you don't know the Bible yet, I recommend Reformed Pres., Orthodox Pres. (all "Pres." mean Presbyterian, but it's such a long word, and I'm lazy, so abbreviate lol) or Pres. Church in America. (Just don't go for PC-USA since they gave up the Bible just about all together a couple of decades ago), for nothing but Bible teaching and fellowship. And the elders would have time to talk to you, if you want them. They will answer your questions, and will even come to your house if that's what you need.
And, yes, I know there are other churches, I just don't know them that well to suggest any others.
Also, be careful about marrying your partner this soon. You've just become born-again making you a new creature. You're different. He's probably getting that, but you said it's only been a few weeks. That hadn't given him time to decide if he likes the new you. One of the big problems with living with someone and then becoming born again is the change of ethics. Many relationships end, if the partner can't take the new creature. Some go strong because both people become born again. Being Christian for so long, I have problems with you living together, but that's a knee-jerk reaction. I have no idea how young folks deal with this position now. (Becoming born again after deciding to live together.) Even as old as I am, I've seen what happens often enough to know you're relationship is at a crossroad. Either he'll end up becoming born again too and you marry. Or he's going to freak ad get angry. Then it's up to both of you to decide what the next step is. Paul covers that in 1 Corinthians. You might want to study that book next to see what your choices are when whatever happens next happens. I honestly can't tell you what happens to your relationship after this other than to know the two of you will always be connected because of your children. Just don't jump the gun on marriage, simply because we long-time Christians freak.
I will pray for you though, because it's going to get harder, before it gets easier.